Aug 01 14:53:42 devstack cinder-volume[77363]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 01 14:53:42 devstack cinder-volume[77363]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 01 14:53:42 devstack cinder-volume[77363]: we strongly recommend against using it for new projects. Aug 01 14:53:42 devstack cinder-volume[77363]: If you are already using Eventlet, we recommend migrating to a different Aug 01 14:53:42 devstack cinder-volume[77363]: framework. For more detail see Aug 01 14:53:42 devstack cinder-volume[77363]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 01 14:53:42 devstack cinder-volume[77363]: import eventlet # noqa Aug 01 14:53:45 devstack cinder-volume[77363]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 01 14:53:45 devstack cinder-volume[77363]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 01 14:53:45 devstack cinder-volume[77363]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 01 14:53:46 devstack cinder-volume[77363]: INFO dbcounter [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Registered counter for database cinder Aug 01 14:53:46 devstack cinder-volume[77363]: DEBUG oslo_db.sqlalchemy.engines [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:53:46 devstack cinder-volume[77363]: DEBUG dbcounter [-] [77363] Writer thread running {{(pid=77363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 01 14:53:46 devstack cinder-volume[77363]: INFO cinder.rpc [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 01 14:53:46 devstack cinder-volume[77363]: INFO cinder.rpc [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 01 14:53:46 devstack cinder-volume[77363]: DEBUG oslo_db.sqlalchemy.engines [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:53:46 devstack cinder-volume[77363]: INFO cinder.volume.manager [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Determined volume DB was empty at startup. Aug 01 14:53:46 devstack cinder-volume[77363]: DEBUG cinder.volume.manager [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77363) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 01 14:53:46 devstack cinder-volume[77363]: INFO cinder.volume.manager [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 01 14:53:46 devstack cinder-volume[77363]: WARNING stevedore.named [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 01 14:53:46 devstack cinder-volume[77363]: WARNING castellan.key_manager [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 01 14:53:46 devstack cinder-volume[77363]: WARNING cinder.keymgr.conf_key_mgr [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 01 14:53:46 devstack cinder-volume[77363]: DEBUG cinder.volume.drivers.lvm [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77363) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 01 14:53:46 devstack cinder-volume[77363]: DEBUG oslo_concurrency.processutils [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_concurrency.processutils [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.473s {{(pid=77363) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_db.sqlalchemy.engines [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:53:47 devstack cinder-volume[77363]: INFO cinder.rpc [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 01 14:53:47 devstack cinder-volume[77363]: INFO cinder.rpc [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 01 14:53:47 devstack cinder-volume[77363]: WARNING stevedore.named [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 01 14:53:47 devstack cinder-volume[77363]: WARNING castellan.key_manager [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 01 14:53:47 devstack cinder-volume[77363]: INFO cinder.volume.manager [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_db.sqlalchemy.engines [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77363) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:53:47 devstack cinder-volume[77363]: INFO oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Starting 1 workers Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Started child 77500 {{(pid=77363) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Full set of CONF: {{(pid=77363) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] ******************************************************************************** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Configuration options gathered from: {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] ================================================================================ {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] allow_availability_zone_fallback = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] allow_compression_on_image_upload = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] allowed_direct_url_schemes = [] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] api_rate_limit = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] auth_strategy = keystone {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] az_cache_duration = 3600 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_availability_zone = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_host = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_name = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_stats_polling_interval = 60 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77500]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backup_api_class = cinder.backup.api.API {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backup_name_template = backup-%s {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backup_use_same_host = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backup_use_temp_snapshot = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] chap_password = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] chap_username = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cinder_internal_tenant_project_id = a73ddb7a1a9f476b869b08a2a8d7f52b {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cinder_internal_tenant_user_id = 72d06e72d1364cc1800a9b3490229696 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cloned_volume_same_az = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cluster = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] compression_format = gzip {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] compute_api_class = cinder.compute.nova.API {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] config_dir = [] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] config_source = [] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] control_exchange = openstack {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] debug = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] default_availability_zone = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] default_group_type = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] default_volume_type = lvmdriver-1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] disk_geometry = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] driver_client_cert = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] driver_client_cert_key = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] driver_data_namespace = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] driver_ssl_cert_path = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] driver_ssl_cert_verify = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] driver_use_ssl = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] enable_force_upload = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] enable_new_services = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] enable_unsupported_driver = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] enforce_multipath_for_image_xfer = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] filter_function = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance_api_insecure = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance_api_servers = ['http://192.168.122.171/image'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance_api_ssl_compression = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance_ca_certificates_file = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance_catalog_info = image:glance:publicURL {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance_certfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance_keyfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance_num_retries = 3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance_request_timeout = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] goodness_function = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] graceful_shutdown_timeout = 5 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] group_api_class = cinder.group.api.API {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] host = devstack {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] image_compress_on_upload = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] image_conversion_address_space_limit = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] image_conversion_cpu_limit = 60 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] image_conversion_disable = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] image_upload_use_cinder_backend = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] image_upload_use_internal_tenant = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] image_volume_cache_enabled = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] image_volume_cache_max_count = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] image_volume_cache_max_size_gb = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] init_host_max_objects_retrieval = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] instance_format = [instance: %(uuid)s] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] iscsi_target_flags = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] iscsi_write_cache = on {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] iser_helper = tgtadm {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] iser_ip_address = 192.168.122.171 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] iser_port = 3260 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] log_color = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] log_config_append = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] log_dir = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] log_file = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] log_options = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] log_rotate_interval = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77500]: INFO cinder.volume.manager [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] log_rotate_interval_type = days {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] log_rotation_type = none {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] max_age = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] max_logfile_count = 30 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] max_logfile_size_mb = 200 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] max_over_subscription_ratio = 20.0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] message_reap_interval = 86400 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] message_ttl = 2592000 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] migration_create_volume_timeout_secs = 300 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] monkey_patch = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] monkey_patch_modules = [] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] my_ip = 192.168.122.171 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] no_snapshot_gb_quota = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] num_iser_scan_tries = 3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] num_shell_tries = 3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] num_volume_device_scan_tries = 3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] nvmeof_conn_info_version = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] nvmet_ns_id = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] nvmet_port_id = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] osapi_max_limit = 1000 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] osapi_volume_ext_list = [] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] osapi_volume_listen_port = 8776 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] osapi_volume_use_ssl = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] osapi_volume_workers = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] per_volume_size_limit = -1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] periodic_fuzzy_delay = 60 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] periodic_interval = 60 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] public_endpoint = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] publish_errors = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] quota_backup_gigabytes = 1000 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] quota_backups = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] quota_gigabytes = 1000 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] quota_groups = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] quota_snapshots = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] quota_volumes = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] rate_limit_burst = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] rate_limit_except_level = CRITICAL {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] rate_limit_interval = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] reinit_driver_count = 3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] replication_device = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] report_discard_supported = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] report_interval = 120 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] reservation_clean_interval = 86400 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] reservation_expire = 86400 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] reserved_image_namespaces = [] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] reserved_percentage = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] rpc_response_timeout = 120 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] run_external_periodic_tasks = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] scst_target_driver = iscsi {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] scst_target_iqn_name = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] service_down_time = 720 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] shell_completion = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] snapshot_name_template = snapshot-%s {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] snapshot_same_host = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] split_loggers = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] state_path = /opt/stack/data/cinder {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] storage_availability_zone = nova {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] storage_protocol = iSCSI {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] syslog_log_facility = LOG_USER {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] target_helper = lioadm {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] target_ip_address = 192.168.122.171 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] target_port = 3260 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] target_protocol = iscsi {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] target_secondary_ip_addresses = [] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] trace_flags = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] transport_url = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] until_refresh = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] use_chap_auth = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] use_default_quota_class = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] use_journal = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] use_json = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] use_multipath_for_image_xfer = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] use_stderr = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] use_syslog = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] verify_glance_signatures = enabled {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_api_class = cinder.volume.api.API {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_backend_name = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_clear = zero {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_clear_ionice = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_clear_size = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_copy_bps_limit = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_dd_blocksize = 1M {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_name_template = volume-%s {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_service_inithost_offload = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volume_usage_audit_period = month {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] zoning_mode = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_concurrency.disable_process_locking = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.auth_section = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.auth_type = password {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.auth_version = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.cache = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.certfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.include_service_catalog = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.insecure = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.interface = public {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.keyfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_password = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcache_username = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.region_name = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.service_type = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.171/identity {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.backend = dogpile.cache.null {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.backend_argument = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.backend_expiration_time = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.config_prefix = cache.oslo {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.debug_cache_backend = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.enable_retry_client = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.enable_socket_keepalive = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.enabled = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.expiration_time = 600 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.hashclient_retry_attempts = 2 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.memcache_dead_retry = 300 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.memcache_pool_maxsize = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.memcache_sasl_enabled = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.password = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.proxies = [] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.redis_db = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.redis_server = localhost:6379 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.retry_attempts = 2 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.retry_delay = 0.0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.socket_keepalive_count = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.socket_keepalive_idle = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.socket_keepalive_interval = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.socket_timeout = 1.0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.tls_allowed_ciphers = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.tls_cafile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.tls_certfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.tls_enabled = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.tls_keyfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cache.username = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] coordination.backend_url = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.asyncio_connection = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.asyncio_slave_connection = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.backend = sqlalchemy {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.connection = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.connection_debug = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.connection_parameters = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.connection_recycle_time = 3600 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.connection_trace = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.db_inc_retry_interval = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.db_max_retries = 20 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.db_max_retry_interval = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.db_retry_interval = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.max_overflow = 50 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.max_pool_size = 5 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.max_retries = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.mysql_wsrep_sync_wait = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.pool_timeout = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.retry_interval = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.slave_connection = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.sqlite_synchronous = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.synchronous_reader = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] database.use_db_reconnect = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler.connection_string = messaging:// {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler.enabled = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler.es_doc_type = notification {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler.es_scroll_size = 10000 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler.es_scroll_time = 2m {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler.filter_error_trace = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler.hmac_keys = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler.sentinel_service_name = mymaster {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler.socket_timeout = 0.1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler.trace_requests = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler.trace_sqlalchemy = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler_jaeger.process_tags = {} {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler_jaeger.service_name_prefix = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] profiler_otlp.service_name_prefix = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_policy.enforce_new_defaults = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_policy.policy_default_rule = default {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_policy.policy_file = policy.yaml {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] privsep_osbrick.group = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] privsep_osbrick.helper_command = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] privsep_osbrick.user = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cinder_sys_admin.group = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cinder_sys_admin.helper_command = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] cinder_sys_admin.user = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] service_user.auth_section = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] service_user.auth_type = password {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] service_user.cafile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] service_user.certfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] service_user.collect_timing = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] service_user.insecure = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] service_user.keyfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] service_user.send_service_user_token = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] service_user.split_loggers = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] service_user.timeout = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance.auth_section = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance.auth_type = password {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance.certfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance.collect_timing = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance.insecure = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance.keyfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance.region_name = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance.split_loggers = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] glance.timeout = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.backend_availability_zone = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.chap_password = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.chap_username = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.disk_geometry = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.driver_client_cert = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.driver_client_cert_key = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.driver_data_namespace = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.driver_use_ssl = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.extra_capabilities = {} {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.filter_function = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.goodness_function = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack sudo[77504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.iscsi_target_flags = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.iscsi_write_cache = on {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.iser_helper = tgtadm {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.iser_ip_address = 192.168.122.171 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.iser_port = 3260 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.lvm_share_target = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.lvm_type = auto {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.num_shell_tries = 3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack sudo[77504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.replication_device = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.report_discard_supported = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.reserved_percentage = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.target_helper = tgtadm {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.target_ip_address = 192.168.122.171 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.target_port = 3260 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.target_protocol = iscsi {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.trace_flags = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.unique_fqdn_network = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.use_chap_auth = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.volume_backend_name = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.volume_clear = zero {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.volume_clear_ionice = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.volume_clear_size = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_reports.file_event_handler = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_reports.log_dir = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.backend_host = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.chap_password = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.chap_username = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.disk_geometry = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.driver_client_cert = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.extra_capabilities = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.filter_function = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.goodness_function = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.iser_helper = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.iser_ip_address = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.iser_port = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.lvm_share_target = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.lvm_type = auto {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.num_shell_tries = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.replication_device = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.report_discard_supported = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.reserved_percentage = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.scst_target_driver = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.storage_protocol = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.target_helper = lioadm {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.target_ip_address = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.target_port = 3260 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.trace_flags = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.use_chap_auth = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.volume_clear = zero {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.volume_clear_size = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] lvmdriver-1.volumes_dir = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.ssl = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_notifications.driver = [] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_notifications.retry = -1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] key_manager.fixed_key = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.barbican_api_version = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.barbican_endpoint = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.barbican_endpoint_type = public {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.barbican_region_name = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.cafile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.certfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.collect_timing = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.insecure = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.keyfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.number_of_retries = 60 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.retry_delay = 1 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.send_service_user_token = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.split_loggers = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.timeout = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.verify_ssl = True {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican.verify_ssl_path = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican_service_user.auth_section = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican_service_user.auth_type = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican_service_user.cafile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican_service_user.certfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican_service_user.collect_timing = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican_service_user.insecure = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican_service_user.keyfile = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican_service_user.split_loggers = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] barbican_service_user.timeout = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.approle_role_id = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.approle_secret_id = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.auth_method = approle {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.auth_path = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.kv_mountpoint = secret {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.kv_path = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.kv_version = 2 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.namespace = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.root_token_id = **** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.ssl_ca_crt_file = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.timeout = 60.0 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.token_file = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.token_role = None {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.use_ssl = False {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:53:47 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] ******************************************************************************** {{(pid=77363) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Aug 01 14:53:47 devstack sudo[77504]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:47 devstack sudo[77507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:53:47 devstack sudo[77507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:47 devstack sudo[77507]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 14:53:47 devstack cinder-volume[77500]: INFO cinder.brick.local_dev.lvm [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 01 14:53:47 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:48 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:48 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:48 devstack sudo[77619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 01 14:53:48 devstack sudo[77619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:48 devstack sudo[77619]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:48 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:48 devstack cinder-volume[77500]: DEBUG cinder.brick.local_dev.lvm [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77500) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 01 14:53:48 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:48 devstack sudo[77711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:53:48 devstack sudo[77711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:48 devstack sudo[77711]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:48 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.508s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:48 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:48 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:48 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:48 devstack sudo[77912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:53:48 devstack sudo[77912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:49 devstack sudo[77912]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:49 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:49 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:49 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:49 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:49 devstack sudo[78020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 01 14:53:49 devstack sudo[78020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:49 devstack sudo[78020]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:49 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.325s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:49 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:49 devstack sudo[78114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 01 14:53:49 devstack sudo[78114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:49 devstack sudo[78114]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:49 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:49 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:49 devstack sudo[78117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 01 14:53:49 devstack sudo[78117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:50 devstack sudo[78117]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:50 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.361s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:50 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:50 devstack sudo[78220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:53:50 devstack sudo[78220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:50 devstack sudo[78220]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:50 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:50 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:50 devstack sudo[78223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:53:50 devstack sudo[78223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:50 devstack sudo[78223]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:50 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.378s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:50 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:50 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:50 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:50 devstack sudo[78306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:53:50 devstack sudo[78306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:51 devstack sudo[78306]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:51 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.360s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:51 devstack cinder-volume[77500]: INFO cinder.volume.drivers.lvm [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 01 14:53:51 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:51 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:51 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:51 devstack sudo[78332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:53:51 devstack sudo[78332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:51 devstack sudo[78332]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:51 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:51 devstack cinder-volume[77500]: DEBUG cinder.volume.drivers.lvm [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Updating volume stats {{(pid=77500) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 01 14:53:51 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:51 devstack sudo[78335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 01 14:53:51 devstack sudo[78335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:51 devstack sudo[78335]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:51 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:51 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:51 devstack sudo[78338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:53:51 devstack sudo[78338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:51 devstack sudo[78338]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:51 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:51 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:51 devstack sudo[78341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:53:51 devstack sudo[78341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:52 devstack sudo[78341]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:52 devstack sudo[78351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:53:52 devstack sudo[78351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:52 devstack sudo[78351]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:52 devstack cinder-volume[77500]: INFO cinder.volume.driver [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Driver hasn't implemented _init_vendor_properties() Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG cinder.volume.driver [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77500) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG oslo_db.sqlalchemy.engines [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77500) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG dbcounter [-] [77500] Writer thread running {{(pid=77500) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG cinder.db.api [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Building query based on filter {{(pid=77500) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG cinder.image.image_utils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77500) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1309}} Aug 01 14:53:52 devstack cinder-volume[77500]: INFO cinder.keymgr.migration [None req-e9a52183-073d-43ec-9550-d5585d580fe1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG cinder.volume.drivers.lvm [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Updating volume stats {{(pid=77500) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:52 devstack sudo[78354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 01 14:53:52 devstack sudo[78354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:52 devstack sudo[78354]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:52 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:52 devstack sudo[78358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:53:52 devstack sudo[78358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:53 devstack sudo[78358]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:53 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:53 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:53 devstack sudo[78362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:53:53 devstack sudo[78362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:53 devstack sudo[78362]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:53 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:53 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:53 devstack sudo[78365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:53:53 devstack sudo[78365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:53 devstack sudo[78365]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:53 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:53 devstack cinder-volume[77500]: DEBUG cinder.manager [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Notifying Schedulers of capabilities ... {{(pid=77500) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 14:53:53 devstack cinder-volume[77500]: INFO cinder.volume.manager [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Driver initialization completed successfully. Aug 01 14:53:53 devstack cinder-volume[77500]: INFO cinder.manager [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Initiating service 2 cleanup Aug 01 14:53:53 devstack cinder-volume[77500]: INFO cinder.manager [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Service 2 cleanup completed. Aug 01 14:53:53 devstack cinder-volume[77500]: DEBUG cinder.service [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Creating RPC server for service cinder-volume {{(pid=77500) start /opt/stack/cinder/cinder/service.py:231}} Aug 01 14:53:53 devstack cinder-volume[77500]: DEBUG cinder.service [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77500) start /opt/stack/cinder/cinder/service.py:237}} Aug 01 14:53:53 devstack cinder-volume[77500]: INFO cinder.volume.manager [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 01 14:53:53 devstack cinder-volume[77500]: DEBUG cinder.volume.drivers.lvm [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Updating volume stats {{(pid=77500) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 01 14:53:53 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:53 devstack sudo[78369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 01 14:53:53 devstack sudo[78369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:54 devstack sudo[78369]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:54 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:54 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:54 devstack sudo[78373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:53:54 devstack sudo[78373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:54 devstack sudo[78373]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:54 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:54 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:54 devstack sudo[78376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:53:54 devstack sudo[78376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:54 devstack sudo[78376]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:54 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:54 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:53:54 devstack sudo[78379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:53:54 devstack sudo[78379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:53:55 devstack sudo[78379]: pam_unix(sudo:session): session closed for user root Aug 01 14:53:55 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:53:55 devstack cinder-volume[77500]: INFO cinder.volume.manager [None req-9066326e-51f6-4d7d-930a-c1f04bd1bd6a None None] Driver post RPC initialization completed successfully. Aug 01 14:53:57 devstack cinder-volume[77363]: DEBUG dbcounter [-] [77363] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77363) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 14:54:05 devstack cinder-volume[77500]: DEBUG dbcounter [-] [77500] Writing DB stats cinder:SELECT=4 {{(pid=77500) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 14:54:05 devstack cinder-volume[77500]: DEBUG dbcounter [-] [77500] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77500) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 14:54:29 devstack cinder-volume[77500]: DEBUG oslo_service.periodic_task [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running periodic task VolumeManager._thread_info {{(pid=77500) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 14:54:29 devstack cinder-volume[77500]: DEBUG cinder.volume.manager [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] thread count: 6 {{(pid=77500) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 14:54:29 devstack cinder-volume[77500]: DEBUG cinder.volume.manager [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] thread info: [<_MainThread(MainThread, started 136327609106560)>, , , , , ] {{(pid=77500) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 14:55:29 devstack cinder-volume[77500]: DEBUG oslo_service.periodic_task [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77500) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 14:55:29 devstack cinder-volume[77500]: DEBUG cinder.volume.drivers.lvm [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Updating volume stats {{(pid=77500) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 01 14:55:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:55:29 devstack sudo[82833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 01 14:55:29 devstack sudo[82833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:55:29 devstack sudo[82833]: pam_unix(sudo:session): session closed for user root Aug 01 14:55:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:55:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:55:29 devstack sudo[82980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:55:29 devstack sudo[82980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:55:29 devstack sudo[82980]: pam_unix(sudo:session): session closed for user root Aug 01 14:55:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:55:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:55:29 devstack sudo[83139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:55:29 devstack sudo[83139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:55:29 devstack sudo[83139]: pam_unix(sudo:session): session closed for user root Aug 01 14:55:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:55:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:55:29 devstack sudo[83271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:55:29 devstack sudo[83271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:55:30 devstack sudo[83271]: pam_unix(sudo:session): session closed for user root Aug 01 14:55:30 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:55:30 devstack cinder-volume[77500]: DEBUG cinder.manager [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Notifying Schedulers of capabilities ... {{(pid=77500) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 14:55:30 devstack cinder-volume[77500]: DEBUG oslo_service.periodic_task [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running periodic task VolumeManager._thread_info {{(pid=77500) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 14:55:30 devstack cinder-volume[77500]: DEBUG cinder.volume.manager [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] thread count: 6 {{(pid=77500) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 14:55:30 devstack cinder-volume[77500]: DEBUG cinder.volume.manager [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] thread info: [<_MainThread(MainThread, started 136327609106560)>, , , , , ] {{(pid=77500) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 14:56:05 devstack cinder-volume[77500]: DEBUG dbcounter [-] [77500] Writing DB stats cinder:SELECT=1 {{(pid=77500) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 14:56:05 devstack cinder-volume[77500]: DEBUG dbcounter [-] [77500] Writing DB stats cinder:UPDATE=1 {{(pid=77500) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 14:56:29 devstack cinder-volume[77500]: DEBUG oslo_service.periodic_task [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77500) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 14:56:29 devstack cinder-volume[77500]: DEBUG cinder.volume.drivers.lvm [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Updating volume stats {{(pid=77500) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 01 14:56:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:56:29 devstack sudo[85369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 01 14:56:29 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:56:29 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root Aug 01 14:56:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:56:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:56:29 devstack sudo[85384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:56:29 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:56:29 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root Aug 01 14:56:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:56:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:56:29 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:56:29 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:56:29 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Aug 01 14:56:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:56:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:56:29 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:56:29 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:56:30 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Aug 01 14:56:30 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:56:30 devstack cinder-volume[77500]: DEBUG cinder.manager [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Notifying Schedulers of capabilities ... {{(pid=77500) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 14:57:29 devstack cinder-volume[77500]: DEBUG oslo_service.periodic_task [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77500) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 14:57:29 devstack cinder-volume[77500]: DEBUG cinder.volume.drivers.lvm [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Updating volume stats {{(pid=77500) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 01 14:57:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:57:29 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 01 14:57:29 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:57:29 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Aug 01 14:57:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:57:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:57:29 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:57:29 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:57:29 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Aug 01 14:57:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:57:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:57:29 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 01 14:57:29 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:57:29 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Aug 01 14:57:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:57:29 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:57:29 devstack sudo[86915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 01 14:57:29 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:57:30 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root Aug 01 14:57:30 devstack cinder-volume[77500]: DEBUG oslo_concurrency.processutils [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=77500) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:57:30 devstack cinder-volume[77500]: DEBUG cinder.manager [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Notifying Schedulers of capabilities ... {{(pid=77500) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 14:57:30 devstack cinder-volume[77500]: DEBUG oslo_service.periodic_task [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] Running periodic task VolumeManager._thread_info {{(pid=77500) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 14:57:30 devstack cinder-volume[77500]: DEBUG cinder.volume.manager [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] thread count: 6 {{(pid=77500) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 14:57:30 devstack cinder-volume[77500]: DEBUG cinder.volume.manager [None req-ece9e973-bb14-4dce-9aef-4aab985dbcc8 None None] thread info: [<_MainThread(MainThread, started 136327609106560)>, , , , , ] {{(pid=77500) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 14:58:05 devstack cinder-volume[77500]: DEBUG dbcounter [-] [77500] Writing DB stats cinder:SELECT=1 {{(pid=77500) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 14:58:05 devstack cinder-volume[77500]: DEBUG dbcounter [-] [77500] Writing DB stats cinder:UPDATE=1 {{(pid=77500) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 14:58:24 devstack cinder-volume[77363]: INFO oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Caught SIGTERM, stopping children Aug 01 14:58:24 devstack cinder-volume[77363]: DEBUG oslo_concurrency.lockutils [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Acquiring lock "singleton_lock" {{(pid=77363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 01 14:58:24 devstack cinder-volume[77363]: DEBUG oslo_concurrency.lockutils [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Acquired lock "singleton_lock" {{(pid=77363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 01 14:58:24 devstack cinder-volume[77363]: DEBUG oslo_concurrency.lockutils [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Releasing lock "singleton_lock" {{(pid=77363) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 01 14:58:24 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Stop services. {{(pid=77363) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 01 14:58:24 devstack cinder-volume[77363]: DEBUG oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Killing children. {{(pid=77363) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 01 14:58:24 devstack cinder-volume[77363]: INFO oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Waiting on 1 children to exit Aug 01 14:58:28 devstack cinder-volume[77500]: DEBUG oslo_concurrency.lockutils [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Acquiring lock "singleton_lock" {{(pid=77500) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 01 14:58:28 devstack cinder-volume[77500]: DEBUG oslo_concurrency.lockutils [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Acquired lock "singleton_lock" {{(pid=77500) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 01 14:58:28 devstack cinder-volume[77500]: DEBUG oslo_concurrency.lockutils [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Releasing lock "singleton_lock" {{(pid=77500) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 01 14:58:28 devstack cinder-volume[77500]: WARNING amqp [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 01 14:58:28 devstack cinder-volume[77500]: WARNING amqp [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 01 14:58:28 devstack cinder-volume[77363]: INFO oslo_service.backend._eventlet.service [None req-ec17d954-af83-4691-a47c-11378080faa6 None None] Child 77500 exited with status 0 Aug 01 14:58:29 devstack cinder-volume[88077]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 01 14:58:29 devstack cinder-volume[88077]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 01 14:58:29 devstack cinder-volume[88077]: we strongly recommend against using it for new projects. Aug 01 14:58:29 devstack cinder-volume[88077]: If you are already using Eventlet, we recommend migrating to a different Aug 01 14:58:29 devstack cinder-volume[88077]: framework. For more detail see Aug 01 14:58:29 devstack cinder-volume[88077]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 01 14:58:29 devstack cinder-volume[88077]: import eventlet # noqa Aug 01 14:58:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 01 14:58:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 01 14:58:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 01 14:58:31 devstack cinder-volume[88077]: INFO dbcounter [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Registered counter for database cinder Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_db.sqlalchemy.engines [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writer thread running {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 01 14:58:32 devstack cinder-volume[88077]: INFO cinder.rpc [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 01 14:58:32 devstack cinder-volume[88077]: INFO cinder.rpc [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_db.sqlalchemy.engines [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:58:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Determined volume DB was empty at startup. Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88077) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 01 14:58:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 01 14:58:32 devstack cinder-volume[88077]: WARNING stevedore.named [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 01 14:58:32 devstack cinder-volume[88077]: WARNING castellan.key_manager [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 01 14:58:32 devstack cinder-volume[88077]: WARNING cinder.keymgr.conf_key_mgr [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 01 14:58:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_db.sqlalchemy.engines [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:58:32 devstack cinder-volume[88077]: INFO oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Starting 1 workers Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Started child 88295 {{(pid=88077) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Full set of CONF: {{(pid=88077) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] ******************************************************************************** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Configuration options gathered from: {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] ================================================================================ {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] allow_availability_zone_fallback = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] allow_compression_on_image_upload = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] allowed_direct_url_schemes = [] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] api_rate_limit = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] auth_strategy = keystone {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_availability_zone = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_host = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_name = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_stats_polling_interval = 60 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backup_api_class = cinder.backup.api.API {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backup_name_template = backup-%s {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backup_use_same_host = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backup_use_temp_snapshot = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] chap_password = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] chap_username = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cinder_internal_tenant_project_id = a73ddb7a1a9f476b869b08a2a8d7f52b {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cinder_internal_tenant_user_id = 72d06e72d1364cc1800a9b3490229696 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88295]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cluster = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] compression_format = gzip {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] compute_api_class = cinder.compute.nova.API {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] config_dir = [] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] config_source = [] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] control_exchange = openstack {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] debug = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] default_availability_zone = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] default_group_type = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] default_volume_type = QuobyteHD {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] disk_geometry = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] driver_client_cert = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] driver_client_cert_key = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] driver_data_namespace = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] driver_ssl_cert_path = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] driver_ssl_cert_verify = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] driver_use_ssl = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] enable_new_services = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] enable_unsupported_driver = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] enabled_backends = ['QuobyteHD'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] enforce_multipath_for_image_xfer = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] filter_function = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance_api_insecure = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance_api_servers = ['http://192.168.122.171/image'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance_api_ssl_compression = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance_ca_certificates_file = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance_catalog_info = image:glance:publicURL {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance_certfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance_keyfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance_num_retries = 3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance_request_timeout = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] goodness_function = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] graceful_shutdown_timeout = 5 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] group_api_class = cinder.group.api.API {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] host = devstack {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] image_compress_on_upload = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] image_conversion_address_space_limit = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] image_conversion_cpu_limit = 60 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] image_conversion_disable = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] image_upload_use_cinder_backend = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] image_upload_use_internal_tenant = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] image_volume_cache_enabled = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] image_volume_cache_max_count = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] image_volume_cache_max_size_gb = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] init_host_max_objects_retrieval = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] instance_format = [instance: %(uuid)s] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] iscsi_target_flags = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] iscsi_write_cache = on {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] iser_helper = tgtadm {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] iser_ip_address = 192.168.122.171 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] iser_port = 3260 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] log_color = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] log_config_append = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] log_dir = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] log_file = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] log_options = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] log_rotate_interval = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] log_rotate_interval_type = days {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] log_rotation_type = none {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] max_age = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] max_logfile_count = 30 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] max_logfile_size_mb = 200 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] max_over_subscription_ratio = 20.0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] message_reap_interval = 86400 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] message_ttl = 2592000 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] migration_create_volume_timeout_secs = 300 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] monkey_patch = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] monkey_patch_modules = [] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] my_ip = 192.168.122.171 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] no_snapshot_gb_quota = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] num_iser_scan_tries = 3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] num_shell_tries = 3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] num_volume_device_scan_tries = 3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] nvmeof_conn_info_version = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] nvmet_ns_id = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] nvmet_port_id = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] osapi_max_limit = 1000 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] osapi_volume_ext_list = [] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] osapi_volume_listen_port = 8776 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] osapi_volume_use_ssl = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] osapi_volume_workers = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] per_volume_size_limit = -1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] periodic_fuzzy_delay = 60 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] periodic_interval = 60 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] public_endpoint = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] publish_errors = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] quota_backup_gigabytes = 1000 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] quota_backups = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] quota_gigabytes = 1000 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] quota_groups = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] quota_snapshots = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] quota_volumes = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] rate_limit_burst = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] rate_limit_except_level = CRITICAL {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] rate_limit_interval = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] reinit_driver_count = 3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] replication_device = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] report_discard_supported = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] report_interval = 120 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] reservation_clean_interval = 86400 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] reservation_expire = 86400 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] reserved_image_namespaces = [] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] reserved_percentage = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] rpc_response_timeout = 120 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] run_external_periodic_tasks = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] scst_target_driver = iscsi {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] scst_target_iqn_name = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] service_down_time = 720 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] shell_completion = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] snapshot_name_template = snapshot-%s {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] split_loggers = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] state_path = /opt/stack/data/cinder {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] storage_availability_zone = nova {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] storage_protocol = iSCSI {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] syslog_log_facility = LOG_USER {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] target_helper = lioadm {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] target_ip_address = 192.168.122.171 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] target_port = 3260 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] target_protocol = iscsi {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] target_secondary_ip_addresses = [] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] trace_flags = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] transport_url = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] until_refresh = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] use_chap_auth = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] use_default_quota_class = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] use_journal = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] use_json = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] use_multipath_for_image_xfer = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] use_stderr = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] use_syslog = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] verify_glance_signatures = enabled {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_api_class = cinder.volume.api.API {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_backend_name = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_clear = zero {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_clear_ionice = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_clear_size = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_copy_bps_limit = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_dd_blocksize = 1M {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_name_template = volume-%s {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_service_inithost_offload = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volume_usage_audit_period = month {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] zoning_mode = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_concurrency.disable_process_locking = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.auth_section = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.auth_type = password {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.auth_version = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.cache = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88295]: INFO cinder.volume.manager [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Starting volume driver QuobyteDriver (1.2) Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.certfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88295]: DEBUG cinder.volume.drivers.remotefs [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88295) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.include_service_catalog = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.insecure = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.interface = public {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.keyfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_password = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcache_username = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.region_name = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.service_type = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.171/identity {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.backend = dogpile.cache.null {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.backend_argument = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.backend_expiration_time = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.config_prefix = cache.oslo {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.debug_cache_backend = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.enable_retry_client = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.enable_socket_keepalive = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.enabled = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.expiration_time = 600 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.hashclient_retry_attempts = 2 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.memcache_dead_retry = 300 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.memcache_pool_maxsize = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.memcache_sasl_enabled = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.password = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.proxies = [] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.redis_db = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.redis_server = localhost:6379 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.retry_attempts = 2 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.retry_delay = 0.0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.socket_keepalive_count = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.socket_keepalive_idle = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.socket_keepalive_interval = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.socket_timeout = 1.0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.tls_allowed_ciphers = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.tls_cafile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.tls_certfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.tls_enabled = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.tls_keyfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cache.username = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] coordination.backend_url = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.asyncio_connection = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.asyncio_slave_connection = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.backend = sqlalchemy {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.connection = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.connection_debug = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.connection_parameters = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.connection_recycle_time = 3600 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.connection_trace = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.db_inc_retry_interval = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.db_max_retries = 20 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.db_max_retry_interval = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.db_retry_interval = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.max_overflow = 50 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.max_pool_size = 5 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.max_retries = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.mysql_wsrep_sync_wait = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.pool_timeout = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.retry_interval = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.slave_connection = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.sqlite_synchronous = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.synchronous_reader = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] database.use_db_reconnect = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler.connection_string = messaging:// {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler.enabled = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler.es_doc_type = notification {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler.es_scroll_size = 10000 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler.es_scroll_time = 2m {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler.filter_error_trace = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler.hmac_keys = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler.sentinel_service_name = mymaster {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler.socket_timeout = 0.1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler.trace_requests = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler.trace_sqlalchemy = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler_jaeger.process_tags = {} {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler_jaeger.service_name_prefix = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] profiler_otlp.service_name_prefix = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_policy.enforce_new_defaults = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_policy.policy_default_rule = default {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_policy.policy_file = policy.yaml {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] privsep_osbrick.group = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] privsep_osbrick.helper_command = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] privsep_osbrick.user = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cinder_sys_admin.group = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cinder_sys_admin.helper_command = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] cinder_sys_admin.user = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] service_user.auth_section = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] service_user.auth_type = password {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] service_user.cafile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] service_user.certfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] service_user.collect_timing = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] service_user.insecure = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] service_user.keyfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] service_user.send_service_user_token = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] service_user.split_loggers = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] service_user.timeout = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance.auth_section = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance.auth_type = password {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance.certfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance.collect_timing = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance.insecure = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance.keyfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance.region_name = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance.split_loggers = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] glance.timeout = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.backend_availability_zone = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.chap_password = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.chap_username = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.disk_geometry = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.driver_client_cert = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.driver_client_cert_key = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.driver_data_namespace = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.driver_use_ssl = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.extra_capabilities = {} {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.filter_function = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.goodness_function = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.iscsi_target_flags = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.iscsi_write_cache = on {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.iser_helper = tgtadm {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.iser_ip_address = 192.168.122.171 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.iser_port = 3260 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nas_host = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nas_login = admin {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nas_mount_options = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nas_password = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nas_private_key = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nas_share_path = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.num_shell_tries = 3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.quobyte_volume_url = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.replication_device = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.report_discard_supported = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.reserved_percentage = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.target_helper = tgtadm {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.target_ip_address = 192.168.122.171 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.target_port = 3260 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.target_protocol = iscsi {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.trace_flags = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.unique_fqdn_network = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.use_chap_auth = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.volume_backend_name = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.volume_clear = zero {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.volume_clear_ionice = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.volume_clear_size = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_reports.file_event_handler = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_reports.log_dir = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.backend_availability_zone = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.backend_host = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.chap_password = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.chap_username = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.chiscsi_conf = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.disk_geometry = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.driver_client_cert = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.driver_data_namespace = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.driver_use_ssl = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.extra_capabilities = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.filter_function = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.goodness_function = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.iser_helper = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.iser_ip_address = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.iser_port = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.iser_target_prefix = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nas_host = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nas_login = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nas_mount_options = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nas_password = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nas_private_key = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nas_share_path = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nas_ssh_port = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.num_shell_tries = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.nvmet_port_id = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.replication_device = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.report_discard_supported = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.reserved_percentage = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.scst_target_driver = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.storage_protocol = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88295]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88295) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 01 14:58:32 devstack cinder-volume[88295]: WARNING cinder.volume.drivers.quobyte [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 01 14:58:32 devstack cinder-volume[88295]: WARNING cinder.volume.drivers.quobyte [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.target_helper = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.target_ip_address = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.target_port = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.target_prefix = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88295]: DEBUG oslo_concurrency.processutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Running cmd (subprocess): mount.quobyte {{(pid=88295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.target_protocol = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.trace_flags = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.use_chap_auth = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.volume_clear = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.volume_clear_size = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] QuobyteHD.volumes_dir = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:32 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.ssl = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_notifications.driver = [] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_notifications.retry = -1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] key_manager.fixed_key = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.barbican_api_version = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.barbican_endpoint = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.barbican_endpoint_type = public {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.barbican_region_name = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.cafile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.certfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.collect_timing = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.insecure = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.keyfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.number_of_retries = 60 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.retry_delay = 1 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.send_service_user_token = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.split_loggers = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.timeout = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.verify_ssl = True {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican.verify_ssl_path = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican_service_user.auth_section = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican_service_user.auth_type = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican_service_user.cafile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican_service_user.certfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican_service_user.collect_timing = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican_service_user.insecure = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican_service_user.keyfile = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican_service_user.split_loggers = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] barbican_service_user.timeout = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.approle_role_id = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.approle_secret_id = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.auth_method = approle {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.auth_path = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.kv_mountpoint = secret {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.kv_path = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.kv_version = 2 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.namespace = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.root_token_id = **** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.ssl_ca_crt_file = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.timeout = 60.0 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.token_file = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.token_role = None {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.use_ssl = False {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:33 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] ******************************************************************************** {{(pid=88077) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Aug 01 14:58:33 devstack quobyte-client[88298]: Reading configuration file: /etc/quobyte/client.cfg Aug 01 14:58:33 devstack quobyte-client[88298]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.processutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] CMD "mount.quobyte" returned: 1 in 0.121s {{(pid=88295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=88295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 14:58:33 devstack cinder-volume[88295]: INFO cinder.volume.drivers.quobyte [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 ... Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.processutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa -c /etc/quobyte/client-cinder.cfg {{(pid=88295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:58:33 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa -c /etc/quobyte/client-cinder.cfg Aug 01 14:58:33 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:58:33 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.processutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.367s {{(pid=88295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:58:33 devstack cinder-volume[88295]: INFO cinder.volume.drivers.quobyte [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 succeeded Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=88295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.378s {{(pid=88295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.processutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=88295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:58:33 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 14:58:33 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:58:33 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.processutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.231s {{(pid=88295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:58:33 devstack cinder-volume[88295]: INFO cinder.volume.driver [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Driver hasn't implemented _init_vendor_properties() Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG cinder.volume.driver [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576751708984, 'free_capacity_gb': 1775.7576751708984, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88295) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_db.sqlalchemy.engines [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG dbcounter [-] [88295] Writer thread running {{(pid=88295) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG cinder.db.api [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Building query based on filter {{(pid=88295) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG cinder.image.image_utils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88295) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1309}} Aug 01 14:58:33 devstack cinder-volume[88295]: INFO cinder.keymgr.migration [None req-7ba57f53-40f3-4f31-825c-ec54ed722bcd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=88295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=88295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:58:33 devstack cinder-volume[88295]: DEBUG oslo_concurrency.processutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=88295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:58:33 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 14:58:33 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:58:34 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Aug 01 14:58:34 devstack cinder-volume[88295]: DEBUG oslo_concurrency.processutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.371s {{(pid=88295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:58:34 devstack cinder-volume[88295]: DEBUG cinder.manager [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Notifying Schedulers of capabilities ... {{(pid=88295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 14:58:34 devstack cinder-volume[88295]: INFO cinder.volume.manager [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Driver initialization completed successfully. Aug 01 14:58:34 devstack cinder-volume[88295]: INFO cinder.manager [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Initiating service 3 cleanup Aug 01 14:58:34 devstack cinder-volume[88295]: INFO cinder.manager [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Service 3 cleanup completed. Aug 01 14:58:34 devstack cinder-volume[88295]: DEBUG cinder.service [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Creating RPC server for service cinder-volume {{(pid=88295) start /opt/stack/cinder/cinder/service.py:231}} Aug 01 14:58:34 devstack cinder-volume[88295]: DEBUG cinder.service [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88295) start /opt/stack/cinder/cinder/service.py:237}} Aug 01 14:58:34 devstack cinder-volume[88295]: INFO cinder.volume.manager [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 01 14:58:34 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:58:34 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:58:34 devstack cinder-volume[88295]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=88295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 14:58:34 devstack cinder-volume[88295]: DEBUG cinder.volume.drivers.quobyte [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=88295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 14:58:34 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:58:34 devstack cinder-volume[88295]: DEBUG oslo_concurrency.processutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=88295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:58:34 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 14:58:34 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:58:34 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Aug 01 14:58:34 devstack cinder-volume[88295]: DEBUG oslo_concurrency.processutils [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.353s {{(pid=88295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:58:34 devstack cinder-volume[88295]: INFO cinder.volume.manager [None req-5c3e8a94-1010-4492-bf51-1a5adb014c9f None None] Driver post RPC initialization completed successfully. Aug 01 14:58:38 devstack cinder-volume[88077]: INFO oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Caught SIGTERM, stopping children Aug 01 14:58:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Acquiring lock "singleton_lock" {{(pid=88077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 01 14:58:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Acquired lock "singleton_lock" {{(pid=88077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 01 14:58:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Releasing lock "singleton_lock" {{(pid=88077) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 01 14:58:38 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Stop services. {{(pid=88077) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 01 14:58:38 devstack cinder-volume[88077]: DEBUG oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Killing children. {{(pid=88077) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 01 14:58:38 devstack cinder-volume[88077]: INFO oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Waiting on 1 children to exit Aug 01 14:58:40 devstack cinder-volume[88295]: DEBUG oslo_service.periodic_task [None req-e17acba2-75b5-402c-bcbc-2ba7ea1f41f8 None None] Running periodic task VolumeManager._thread_info {{(pid=88295) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 14:58:40 devstack cinder-volume[88295]: DEBUG cinder.volume.manager [None req-e17acba2-75b5-402c-bcbc-2ba7ea1f41f8 None None] thread count: 6 {{(pid=88295) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 14:58:40 devstack cinder-volume[88295]: DEBUG cinder.volume.manager [None req-e17acba2-75b5-402c-bcbc-2ba7ea1f41f8 None None] thread info: [<_MainThread(MainThread, started 136206391697536)>, , , , , ] {{(pid=88295) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 14:58:42 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Acquiring lock "singleton_lock" {{(pid=88295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 01 14:58:42 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Acquired lock "singleton_lock" {{(pid=88295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 01 14:58:42 devstack cinder-volume[88295]: DEBUG oslo_concurrency.lockutils [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Releasing lock "singleton_lock" {{(pid=88295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 01 14:58:42 devstack cinder-volume[88295]: WARNING amqp [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 01 14:58:42 devstack cinder-volume[88295]: WARNING amqp [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 01 14:58:42 devstack cinder-volume[88077]: INFO oslo_service.backend._eventlet.service [None req-9758ba86-4b78-4bb1-bb23-2a3e8aab2674 None None] Child 88295 exited with status 0 Aug 01 14:58:43 devstack cinder-volume[88713]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 01 14:58:43 devstack cinder-volume[88713]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 01 14:58:43 devstack cinder-volume[88713]: we strongly recommend against using it for new projects. Aug 01 14:58:43 devstack cinder-volume[88713]: If you are already using Eventlet, we recommend migrating to a different Aug 01 14:58:43 devstack cinder-volume[88713]: framework. For more detail see Aug 01 14:58:43 devstack cinder-volume[88713]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 01 14:58:43 devstack cinder-volume[88713]: import eventlet # noqa Aug 01 14:58:45 devstack cinder-volume[88713]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88713) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 01 14:58:45 devstack cinder-volume[88713]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88713) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 01 14:58:45 devstack cinder-volume[88713]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88713) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 01 14:58:46 devstack cinder-volume[88713]: INFO dbcounter [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Registered counter for database cinder Aug 01 14:58:46 devstack cinder-volume[88713]: DEBUG oslo_db.sqlalchemy.engines [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88713) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:58:46 devstack cinder-volume[88713]: DEBUG dbcounter [-] [88713] Writer thread running {{(pid=88713) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 01 14:58:46 devstack cinder-volume[88713]: INFO cinder.rpc [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 01 14:58:46 devstack cinder-volume[88713]: INFO cinder.rpc [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 01 14:58:46 devstack cinder-volume[88713]: DEBUG oslo_db.sqlalchemy.engines [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88713) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:58:46 devstack cinder-volume[88713]: INFO cinder.volume.manager [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Determined volume DB was empty at startup. Aug 01 14:58:46 devstack cinder-volume[88713]: DEBUG cinder.volume.manager [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88713) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 01 14:58:46 devstack cinder-volume[88713]: WARNING stevedore.named [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 01 14:58:46 devstack cinder-volume[88713]: WARNING castellan.key_manager [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 01 14:58:46 devstack cinder-volume[88713]: WARNING cinder.keymgr.conf_key_mgr [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 01 14:58:46 devstack cinder-volume[88713]: INFO cinder.volume.manager [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_db.sqlalchemy.engines [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88713) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:58:47 devstack cinder-volume[88713]: INFO oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Starting 1 workers Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Started child 89024 {{(pid=88713) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Full set of CONF: {{(pid=88713) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] ******************************************************************************** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] Configuration options gathered from: {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] ================================================================================ {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] allow_availability_zone_fallback = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] allow_compression_on_image_upload = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] allowed_direct_url_schemes = [] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] api_rate_limit = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] auth_strategy = keystone {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_availability_zone = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_host = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_name = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_stats_polling_interval = 60 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backup_api_class = cinder.backup.api.API {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backup_name_template = backup-%s {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backup_use_same_host = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backup_use_temp_snapshot = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] chap_password = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] chap_username = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cinder_internal_tenant_project_id = a73ddb7a1a9f476b869b08a2a8d7f52b {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cinder_internal_tenant_user_id = 72d06e72d1364cc1800a9b3490229696 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[89024]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cluster = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] compression_format = gzip {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] compute_api_class = cinder.compute.nova.API {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] config_dir = [] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] config_source = [] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] control_exchange = openstack {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] debug = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] default_availability_zone = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] default_group_type = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] default_volume_type = QuobyteHD {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] disk_geometry = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] driver_client_cert = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] driver_client_cert_key = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] driver_data_namespace = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] driver_ssl_cert_path = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] driver_ssl_cert_verify = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] driver_use_ssl = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] enable_new_services = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] enable_unsupported_driver = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] enabled_backends = ['QuobyteHD'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] enforce_multipath_for_image_xfer = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] filter_function = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance_api_insecure = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance_api_servers = ['http://192.168.122.171/image'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance_api_ssl_compression = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance_ca_certificates_file = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance_catalog_info = image:glance:publicURL {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance_certfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance_keyfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance_num_retries = 3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance_request_timeout = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] goodness_function = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] graceful_shutdown_timeout = 5 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] group_api_class = cinder.group.api.API {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] host = devstack {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] image_compress_on_upload = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] image_conversion_address_space_limit = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] image_conversion_cpu_limit = 60 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] image_conversion_disable = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] image_upload_use_cinder_backend = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] image_upload_use_internal_tenant = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] image_volume_cache_enabled = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] image_volume_cache_max_count = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] image_volume_cache_max_size_gb = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] init_host_max_objects_retrieval = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] instance_format = [instance: %(uuid)s] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] iscsi_target_flags = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] iscsi_write_cache = on {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] iser_helper = tgtadm {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] iser_ip_address = 192.168.122.171 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] iser_port = 3260 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] log_color = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] log_config_append = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] log_dir = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] log_file = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] log_options = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] log_rotate_interval = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] log_rotate_interval_type = days {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] log_rotation_type = none {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] max_age = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] max_logfile_count = 30 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] max_logfile_size_mb = 200 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] max_over_subscription_ratio = 20.0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] message_reap_interval = 86400 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] message_ttl = 2592000 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] migration_create_volume_timeout_secs = 300 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] monkey_patch = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] monkey_patch_modules = [] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] my_ip = 192.168.122.171 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] no_snapshot_gb_quota = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] num_iser_scan_tries = 3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] num_shell_tries = 3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] num_volume_device_scan_tries = 3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] nvmeof_conn_info_version = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] nvmet_ns_id = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] nvmet_port_id = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] osapi_max_limit = 1000 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] osapi_volume_ext_list = [] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] osapi_volume_listen_port = 8776 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] osapi_volume_use_ssl = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] osapi_volume_workers = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] per_volume_size_limit = -1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] periodic_fuzzy_delay = 60 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] periodic_interval = 60 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] public_endpoint = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] publish_errors = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] quota_backup_gigabytes = 1000 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] quota_backups = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] quota_gigabytes = 1000 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] quota_groups = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] quota_snapshots = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] quota_volumes = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] rate_limit_burst = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] rate_limit_except_level = CRITICAL {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] rate_limit_interval = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] reinit_driver_count = 3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] replication_device = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] report_discard_supported = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] report_interval = 120 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] reservation_clean_interval = 86400 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] reservation_expire = 86400 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] reserved_image_namespaces = [] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] reserved_percentage = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] rpc_response_timeout = 120 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] run_external_periodic_tasks = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] scst_target_driver = iscsi {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] scst_target_iqn_name = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] service_down_time = 720 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] shell_completion = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] snapshot_name_template = snapshot-%s {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] split_loggers = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] state_path = /opt/stack/data/cinder {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] storage_availability_zone = nova {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Starting volume driver QuobyteDriver (1.2) Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] storage_protocol = iSCSI {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] syslog_log_facility = LOG_USER {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] target_helper = lioadm {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] target_ip_address = 192.168.122.171 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] target_port = 3260 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=89024) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] target_protocol = iscsi {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] target_secondary_ip_addresses = [] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] trace_flags = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] transport_url = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] until_refresh = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] use_chap_auth = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] use_default_quota_class = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] use_journal = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] use_json = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] use_multipath_for_image_xfer = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] use_stderr = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] use_syslog = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] verify_glance_signatures = enabled {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_api_class = cinder.volume.api.API {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_backend_name = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_clear = zero {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_clear_ionice = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_clear_size = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_copy_bps_limit = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_dd_blocksize = 1M {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_name_template = volume-%s {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_service_inithost_offload = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volume_usage_audit_period = month {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] zoning_mode = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_concurrency.disable_process_locking = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.auth_section = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.auth_type = password {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.auth_version = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.cache = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.certfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.include_service_catalog = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.insecure = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.interface = public {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.keyfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_password = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcache_username = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.region_name = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.service_type = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.171/identity {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.backend = dogpile.cache.null {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.backend_argument = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.backend_expiration_time = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.config_prefix = cache.oslo {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.debug_cache_backend = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.enable_retry_client = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.enable_socket_keepalive = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.enabled = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.expiration_time = 600 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.hashclient_retry_attempts = 2 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.memcache_dead_retry = 300 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.memcache_pool_maxsize = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.memcache_sasl_enabled = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.password = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.proxies = [] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.redis_db = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.redis_server = localhost:6379 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.retry_attempts = 2 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.retry_delay = 0.0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.socket_keepalive_count = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.socket_keepalive_idle = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.socket_keepalive_interval = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.socket_timeout = 1.0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.tls_allowed_ciphers = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.tls_cafile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.tls_certfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.tls_enabled = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.tls_keyfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cache.username = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] coordination.backend_url = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.asyncio_connection = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.asyncio_slave_connection = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.backend = sqlalchemy {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.connection = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.connection_debug = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.connection_parameters = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.connection_recycle_time = 3600 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.connection_trace = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.db_inc_retry_interval = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.db_max_retries = 20 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.db_max_retry_interval = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.db_retry_interval = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.max_overflow = 50 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.max_pool_size = 5 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.max_retries = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.mysql_wsrep_sync_wait = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.pool_timeout = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.retry_interval = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.slave_connection = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.sqlite_synchronous = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.synchronous_reader = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] database.use_db_reconnect = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler.connection_string = messaging:// {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler.enabled = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler.es_doc_type = notification {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler.es_scroll_size = 10000 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler.es_scroll_time = 2m {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler.filter_error_trace = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler.hmac_keys = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler.sentinel_service_name = mymaster {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler.socket_timeout = 0.1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler.trace_requests = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler.trace_sqlalchemy = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler_jaeger.process_tags = {} {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler_jaeger.service_name_prefix = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] profiler_otlp.service_name_prefix = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_policy.enforce_new_defaults = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_policy.policy_default_rule = default {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_policy.policy_file = policy.yaml {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] privsep_osbrick.group = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] privsep_osbrick.helper_command = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] privsep_osbrick.user = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cinder_sys_admin.group = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cinder_sys_admin.helper_command = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] cinder_sys_admin.user = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] service_user.auth_section = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] service_user.auth_type = password {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] service_user.cafile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] service_user.certfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] service_user.collect_timing = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] service_user.insecure = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] service_user.keyfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] service_user.send_service_user_token = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] service_user.split_loggers = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] service_user.timeout = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance.auth_section = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance.auth_type = password {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance.certfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance.collect_timing = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance.insecure = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance.keyfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance.region_name = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance.split_loggers = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] glance.timeout = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.backend_availability_zone = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.chap_password = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.chap_username = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.disk_geometry = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.driver_client_cert = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.driver_client_cert_key = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.driver_data_namespace = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.driver_use_ssl = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.extra_capabilities = {} {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.filter_function = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.goodness_function = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.iscsi_target_flags = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.iscsi_write_cache = on {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.iser_helper = tgtadm {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.iser_ip_address = 192.168.122.171 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.iser_port = 3260 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nas_host = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nas_login = admin {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nas_mount_options = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nas_password = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nas_private_key = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nas_share_path = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.num_shell_tries = 3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=89024) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 01 14:58:47 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.quobyte [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.quobyte [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.quobyte_volume_url = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.replication_device = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.report_discard_supported = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.reserved_percentage = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Running cmd (subprocess): mount.quobyte {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.target_helper = tgtadm {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.target_ip_address = 192.168.122.171 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.target_port = 3260 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.target_protocol = iscsi {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.trace_flags = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.unique_fqdn_network = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.use_chap_auth = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.volume_backend_name = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.volume_clear = zero {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.volume_clear_ionice = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.volume_clear_size = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_reports.file_event_handler = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_reports.log_dir = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.backend_availability_zone = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.backend_host = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.chap_password = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.chap_username = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.chiscsi_conf = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.disk_geometry = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.driver_client_cert = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.driver_data_namespace = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.driver_use_ssl = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.extra_capabilities = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.filter_function = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.goodness_function = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.iser_helper = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.iser_ip_address = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.iser_port = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.iser_target_prefix = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nas_host = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nas_login = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nas_mount_options = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nas_password = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nas_private_key = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nas_share_path = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nas_ssh_port = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.num_shell_tries = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.nvmet_port_id = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.replication_device = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.report_discard_supported = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.reserved_percentage = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.scst_target_driver = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.storage_protocol = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.target_helper = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.target_ip_address = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.target_port = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.target_prefix = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.target_protocol = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.trace_flags = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.use_chap_auth = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.volume_clear = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.volume_clear_size = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] QuobyteHD.volumes_dir = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack quobyte-client[89025]: Reading configuration file: /etc/quobyte/client.cfg Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack quobyte-client[89025]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] CMD "mount.quobyte" returned: 1 in 0.054s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.ssl = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_notifications.driver = [] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_notifications.retry = -1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] key_manager.fixed_key = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.barbican_api_version = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.barbican_endpoint = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.barbican_endpoint_type = public {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.barbican_region_name = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.cafile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.certfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.collect_timing = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.insecure = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.keyfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.number_of_retries = 60 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.retry_delay = 1 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.send_service_user_token = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.split_loggers = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.timeout = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.verify_ssl = True {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican.verify_ssl_path = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican_service_user.auth_section = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican_service_user.auth_type = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican_service_user.cafile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican_service_user.certfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican_service_user.collect_timing = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican_service_user.insecure = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican_service_user.keyfile = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican_service_user.split_loggers = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] barbican_service_user.timeout = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.approle_role_id = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.approle_secret_id = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.auth_method = approle {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.auth_path = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.kv_mountpoint = secret {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.kv_path = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.kv_version = 2 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.namespace = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.root_token_id = **** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.ssl_ca_crt_file = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.timeout = 60.0 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.token_file = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.token_role = None {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.use_ssl = False {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 01 14:58:47 devstack cinder-volume[88713]: DEBUG oslo_service.backend._eventlet.service [None req-f8c13e02-1a81-4673-933f-be93e9379c75 None None] ******************************************************************************** {{(pid=88713) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Aug 01 14:58:47 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 14:58:47 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.254s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:58:47 devstack cinder-volume[89024]: INFO cinder.volume.driver [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Driver hasn't implemented _init_vendor_properties() Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG cinder.volume.driver [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576751708984, 'free_capacity_gb': 1775.7576751708984, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89024) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 01 14:58:47 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_db.sqlalchemy.engines [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89024) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writer thread running {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG cinder.db.api [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Building query based on filter {{(pid=89024) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89024) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1309}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:58:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:58:47 devstack cinder-volume[89024]: INFO cinder.keymgr.migration [None req-5d688b22-5726-45bf-af8b-1e52f7a9fcc8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 01 14:58:47 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 14:58:47 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:58:48 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Aug 01 14:58:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.320s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:58:48 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 14:58:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Driver initialization completed successfully. Aug 01 14:58:48 devstack cinder-volume[89024]: INFO cinder.manager [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Initiating service 3 cleanup Aug 01 14:58:48 devstack cinder-volume[89024]: INFO cinder.manager [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Service 3 cleanup completed. Aug 01 14:58:48 devstack cinder-volume[89024]: DEBUG cinder.service [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Creating RPC server for service cinder-volume {{(pid=89024) start /opt/stack/cinder/cinder/service.py:231}} Aug 01 14:58:48 devstack cinder-volume[89024]: DEBUG cinder.service [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=89024) start /opt/stack/cinder/cinder/service.py:237}} Aug 01 14:58:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 01 14:58:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:58:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:58:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 14:58:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 14:58:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:58:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:58:48 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 14:58:48 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:58:48 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Aug 01 14:58:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.262s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:58:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-80e9fb53-3cca-4e50-ac77-4861b51bd6c9 None None] Driver post RPC initialization completed successfully. Aug 01 14:58:57 devstack cinder-volume[88713]: DEBUG dbcounter [-] [88713] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88713) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 14:58:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-68a32fef-f4bc-40b6-916b-7e0fb0195c5a tempest-BackendsCapabilitiesAdminTestsJSON-223639650 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576751708984, 'free_capacity_gb': 1775.7576751708984, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89024) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 01 14:58:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c241df89-cc5b-4142-ab37-ec52c174b2f1 tempest-BackendsCapabilitiesAdminTestsJSON-223639650 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576751708984, 'free_capacity_gb': 1775.7576751708984, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89024) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 01 14:58:58 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 14:58:58 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=2 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 14:59:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 14:59:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 6 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 14:59:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 14:59:44 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 14:59:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Flow 'volume_create_manager' (73270712-cb6e-4338-8bf0-25376fd38bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 14:59:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1337497c-a544-4852-ba9b-514e2d5f6725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1337497c-a544-4852-ba9b-514e2d5f6725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T12:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1412937451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08478fcc-71ec-45a5-a397-808ea383f7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463de25ea02f4257bd9826ee53f6b52b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T12:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T12:59:45Z,use_quota=True,user_id='f179420e163f42dab8d9f9a7ef9895bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1df499-242e-46f4-8ce3-195a1249b8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1df499-242e-46f4-8ce3-195a1249b8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbe3296-540d-4b76-b443-928a18552c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbe3296-540d-4b76-b443-928a18552c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08478fcc-71ec-45a5-a397-808ea383f7c7', 'volume_name': 'volume-08478fcc-71ec-45a5-a397-808ea383f7c7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5d0d77-5dec-4168-b54f-233da0850164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5d0d77-5dec-4168-b54f-233da0850164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7901631-224a-43e0-bb5b-2c73d6f782a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:45 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Volume 08478fcc-71ec-45a5-a397-808ea383f7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08478fcc-71ec-45a5-a397-808ea383f7c7', 'volume_size': 1} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T12:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1412937451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08478fcc-71ec-45a5-a397-808ea383f7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463de25ea02f4257bd9826ee53f6b52b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T12:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T12:59:45Z,use_quota=True,user_id='f179420e163f42dab8d9f9a7ef9895bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Creating volume 08478fcc-71ec-45a5-a397-808ea383f7c7 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 14:59:45 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:45 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7 1073741824 Aug 01 14:59:45 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f5c2b45a-1cb3-433d-a1d0-e6b86ac34f80 tempest-GroupSnapshotsTest-100544624 None] Group tempest-GroupSnapshotsTest-Group-687559128: creating Aug 01 14:59:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f5c2b45a-1cb3-433d-a1d0-e6b86ac34f80 tempest-GroupSnapshotsTest-100544624 None] Group tempest-GroupSnapshotsTest-Group-687559128: created successfully Aug 01 14:59:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f5c2b45a-1cb3-433d-a1d0-e6b86ac34f80 tempest-GroupSnapshotsTest-100544624 None] Create group completed successfully. Aug 01 14:59:45 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7 1073741824" returned: 0 in 0.754s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:46 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7 Aug 01 14:59:46 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:46 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7" returned: 0 in 0.520s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7901631-224a-43e0-bb5b-2c73d6f782a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08478fcc-71ec-45a5-a397-808ea383f7c7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89039b68-b2a2-4b1a-837b-f019d44f66d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Volume volume-08478fcc-71ec-45a5-a397-808ea383f7c7 (08478fcc-71ec-45a5-a397-808ea383f7c7): created successfully Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89039b68-b2a2-4b1a-837b-f019d44f66d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Flow 'volume_create_manager' (73270712-cb6e-4338-8bf0-25376fd38bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 14:59:46 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-bca86653-d196-4c38-aeab-da220220c92e tempest-TaggedAttachmentsTest-1994664291 None] Created volume successfully. Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Flow 'volume_create_manager' (bb45a997-d152-4652-93c7-28345eda974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fb7f0b-c23a-48dd-8db9-dcd4ad7a6056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fb7f0b-c23a-48dd-8db9-dcd4ad7a6056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T12:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1796869697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6034362-da8c-4a3d-a151-0835d62b989d,host='devstack@QuobyteHD#QuobyteHD',id=65a0def8-df11-4127-bb7a-3c323ec35c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4674747124334bc93ff0d5a26bb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T12:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T12:59:47Z,use_quota=True,user_id='c5cfc8dec6b745ad8a091341e4d8d270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd1aebdb-53a9-4ff3-a78e-43b4104618fc),volume_type_id=bd1aebdb-53a9-4ff3-a78e-43b4104618fc)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c78c3e-6dc9-4ddd-a050-26d8d9c122d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c78c3e-6dc9-4ddd-a050-26d8d9c122d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61de924d-b012-42e7-8fe9-0960d3dd2c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61de924d-b012-42e7-8fe9-0960d3dd2c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a0def8-df11-4127-bb7a-3c323ec35c71', 'volume_name': 'volume-65a0def8-df11-4127-bb7a-3c323ec35c71', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9d14b6-ddbd-4e4a-a36e-9ecd71107a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9d14b6-ddbd-4e4a-a36e-9ecd71107a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbe58ca-b9b3-481d-abaa-24f64708d01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Volume 65a0def8-df11-4127-bb7a-3c323ec35c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a0def8-df11-4127-bb7a-3c323ec35c71', 'volume_size': 1} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b6034362-da8c-4a3d-a151-0835d62b989d,created_at=2026-08-01T12:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1796869697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6034362-da8c-4a3d-a151-0835d62b989d,host='devstack@QuobyteHD#QuobyteHD',id=65a0def8-df11-4127-bb7a-3c323ec35c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4674747124334bc93ff0d5a26bb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T12:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T12:59:47Z,use_quota=True,user_id='c5cfc8dec6b745ad8a091341e4d8d270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd1aebdb-53a9-4ff3-a78e-43b4104618fc),volume_type_id=bd1aebdb-53a9-4ff3-a78e-43b4104618fc)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Creating volume 65a0def8-df11-4127-bb7a-3c323ec35c71 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 14:59:46 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 14:59:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:46 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 1073741824 Aug 01 14:59:46 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:47 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 1073741824" returned: 0 in 0.527s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:47 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 Aug 01 14:59:47 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:47 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71" returned: 0 in 0.288s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 14:59:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:59:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbe58ca-b9b3-481d-abaa-24f64708d01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a0def8-df11-4127-bb7a-3c323ec35c71', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68e462d-bf45-4647-bcfd-4a21830e34cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 14:59:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Volume volume-65a0def8-df11-4127-bb7a-3c323ec35c71 (65a0def8-df11-4127-bb7a-3c323ec35c71): created successfully Aug 01 14:59:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68e462d-bf45-4647-bcfd-4a21830e34cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 14:59:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Flow 'volume_create_manager' (bb45a997-d152-4652-93c7-28345eda974e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 14:59:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4002fe21-06a4-4a82-a312-8187869fc0f1 tempest-GroupSnapshotsTest-100544624 None] Created volume successfully. Aug 01 14:59:49 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] GroupSnapshot 194e7e47-3ad2-464d-8d33-ef1b6281c82b: creating. Aug 01 14:59:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Group snapshot 194e7e47-3ad2-464d-8d33-ef1b6281c82b: creating. {{(pid=89024) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 01 14:59:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:59:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:59:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Creating offline snapshot fa64a477-a903-41c6-8d12-d0d9cc37f943 of volume 65a0def8-df11-4127-bb7a-3c323ec35c71 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 14:59:49 devstack cinder-volume[89024]: INFO oslo.privsep.daemon [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpi7i9a6op/privsep.sock'] Aug 01 14:59:49 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpi7i9a6op/privsep.sock Aug 01 14:59:49 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:50 devstack cinder-volume[89024]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 01 14:59:50 devstack cinder-volume[89024]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 01 14:59:50 devstack cinder-volume[89024]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 01 14:59:50 devstack cinder-volume[89024]: WARNING oslo.privsep.daemon [-] privsep log: Aug 01 14:59:50 devstack cinder-volume[89024]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 01 14:59:50 devstack cinder-volume[89024]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 01 14:59:50 devstack cinder-volume[89024]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 01 14:59:50 devstack cinder-volume[89024]: WARNING oslo.privsep.daemon [-] privsep log: Aug 01 14:59:50 devstack cinder-volume[89024]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 01 14:59:51 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:51 devstack cinder-volume[89024]: INFO oslo.privsep.daemon [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Spawned new privsep daemon via rootwrap Aug 01 14:59:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Accepted privsep connection to /tmp/tmpi7i9a6op/privsep.sock {{(pid=89024) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 01 14:59:51 devstack cinder-volume[89024]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 01 14:59:51 devstack cinder-volume[89024]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 01 14:59:51 devstack cinder-volume[89024]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 01 14:59:51 devstack cinder-volume[89024]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89527 Aug 01 14:59:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b72073-0578-4a8b-8f71-27339ba24abe]: (2,) {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 14:59:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed758af2-64d1-4cf2-81bf-4e163d90f460]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 14:59:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:51 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 Aug 01 14:59:51 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:51 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71" returned: 0 in 0.423s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:51 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 1G Aug 01 14:59:51 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:52 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 1G" returned: 0 in 0.623s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a0def8-df11-4127-bb7a-3c323ec35c71 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:52 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a0def8-df11-4127-bb7a-3c323ec35c71 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 Aug 01 14:59:52 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:52 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a0def8-df11-4127-bb7a-3c323ec35c71 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943" returned: 0 in 0.466s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:52 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 is being set with open permissions: ugo+rw: NotImplementedError Aug 01 14:59:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:52 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 Aug 01 14:59:52 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:53 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:53 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.info Aug 01 14:59:53 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:53 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.info" returned: 0 in 0.648s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:53 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.info is being set with open permissions: ugo+rw: NotImplementedError Aug 01 14:59:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:53 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.info Aug 01 14:59:53 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:54 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.info" returned: 0 in 0.332s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.584s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:59:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8c4e873a-7e2b-49b8-baac-e6a1d809286e tempest-GroupSnapshotsTest-100544624 None] group_snapshot 194e7e47-3ad2-464d-8d33-ef1b6281c82b: created successfully Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-fa64a477-a903-41c6-8d12-d0d9cc37f943-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-fa64a477-a903-41c6-8d12-d0d9cc37f943-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Creating volume ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f from snapshot fa64a477-a903-41c6-8d12-d0d9cc37f943 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] snapshot: fa64a477-a903-41c6-8d12-d0d9cc37f943, volume: ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2feff2-3aab-4ff4-8a8e-dab3b3feaf32]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 14:59:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:56 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 Aug 01 14:59:56 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:56 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943" returned: 0 in 0.539s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65a0def8-df11-4127-bb7a-3c323ec35c71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 14:59:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[948ad1e9-f4e3-4b09-bf5d-b271d81b03f1]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 14:59:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:56 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 Aug 01 14:59:56 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 14:59:57 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Aug 01 14:59:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71" returned: 0 in 0.617s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 14:59:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 14:59:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 14:59:57 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 14:59:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 14:59:57 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f Aug 01 14:59:57 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" returned: 0 in 6.454s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:03 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:00:03 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Converted 1024.00 MB image at 158.63 MB/s Aug 01 15:00:03 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:00:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:03 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f Aug 01 15:00:03 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:03 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" returned: 0 in 0.385s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" released by "_copy_volume_from_snapshot" :: held 8.115s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-fa64a477-a903-41c6-8d12-d0d9cc37f943-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" released by "_create_volume_from_snapshot" :: held 8.227s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.254s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-92058027-c5d3-428a-bf40-fc7fa9c17975 tempest-GroupSnapshotsTest-100544624 None] Create group from source-snapshot-194e7e47-3ad2-464d-8d33-ef1b6281c82b completed successfully. Aug 01 15:00:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dddfb02-85e9-44c2-ba1b-a5ee1ae82e4b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:05 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f Aug 01 15:00:05 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:06 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" returned: 0 in 0.744s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:06 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f Aug 01 15:00:06 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:06 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" returned: 0 in 0.381s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-ebe47a80-907f-4fc8-9e4a-bd4d1bc9275f" released by "delete_volume" :: held 1.331s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Created reservations ['3a3a402b-fdf6-469b-9bc5-32b051e468bd'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:00:06 devstack cinder-volume[89024]: WARNING cinder.quota [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-325725580 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-325725580, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:00:06 devstack cinder-volume[89024]: WARNING cinder.quota [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-325725580 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-325725580, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:00:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Created reservations ['fd6fb1c0-cfe8-4ca4-9acc-bcabac62eeb7', '61719383-f779-4464-bd16-957fd4808120', 'a36d3d44-f359-4aea-9438-98af280f77f2', 'abdc771f-0113-491b-bc10-e8429ec3fece'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:00:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:00:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:00:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:07 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:00:07 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:07 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.420s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:07 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:00:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cc60b036-f27d-4636-8a21-f7cef56ae6e7 tempest-GroupSnapshotsTest-100544624 None] Delete group completed successfully. Aug 01 15:00:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] group_snapshot 194e7e47-3ad2-464d-8d33-ef1b6281c82b: deleting Aug 01 15:00:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] group_snapshot 194e7e47-3ad2-464d-8d33-ef1b6281c82b: deleting {{(pid=89024) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 01 15:00:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-65a0def8-df11-4127-bb7a-3c323ec35c71" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-65a0def8-df11-4127-bb7a-3c323ec35c71" acquired by "delete_snapshot" :: waited 0.064s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-fa64a477-a903-41c6-8d12-d0d9cc37f943" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-fa64a477-a903-41c6-8d12-d0d9cc37f943" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Deleting offline snapshot fa64a477-a903-41c6-8d12-d0d9cc37f943 of volume 65a0def8-df11-4127-bb7a-3c323ec35c71 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:00:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] snapshot_file for this snap is: volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:00:08 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5b1f08-49ed-4308-9c6e-f7fa05cb8a07]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:08 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 Aug 01 15:00:08 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:09 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943" returned: 0 in 0.986s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65a0def8-df11-4127-bb7a-3c323ec35c71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:00:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dd4432-27de-4432-87cc-54e3e72b643a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:09 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 Aug 01 15:00:09 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:10 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71" returned: 0 in 0.837s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:10 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 Aug 01 15:00:10 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:11 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943" returned: 0 in 0.998s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:11 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943 Aug 01 15:00:11 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:12 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71.fa64a477-a903-41c6-8d12-d0d9cc37f943" returned: 0 in 0.499s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-fa64a477-a903-41c6-8d12-d0d9cc37f943" released by "_delete_snapshot" :: held 3.515s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-65a0def8-df11-4127-bb7a-3c323ec35c71" released by "delete_snapshot" :: held 3.572s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:12 devstack cinder-volume[89024]: WARNING cinder.quota [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-325725580 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-325725580, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:00:12 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] Created reservations ['94c58508-3af2-4e59-90fa-a3444b3bd2da', '431cdc1f-88fb-4ff0-acfb-a9e309088bed', 'e879278d-b364-47e9-9060-447353836b1b', '4eead1d5-1902-44e4-952e-1b9147e9ba5c'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:00:12 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e836a5d6-bc5d-49a8-ba5f-0a7746b85103 tempest-GroupSnapshotsTest-100544624 None] group_snapshot 194e7e47-3ad2-464d-8d33-ef1b6281c82b: deleted successfully Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Flow 'volume_create_manager' (3fd8affd-d854-4d37-bab4-30e3ca44378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ff0d19-82da-4339-b9db-062700df0526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ff0d19-82da-4339-b9db-062700df0526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1197943217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3774d89c-140d-4289-aa3d-905627556287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb4e1babaab4f14908e362da2d3c54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:00:13Z,use_quota=True,user_id='794e1b70e3c249b3aa12aeac2abc6714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5e26e6-5ec2-433c-b81c-13f3369352c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5e26e6-5ec2-433c-b81c-13f3369352c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8ea158-4425-402b-b93b-42e4d00833c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8ea158-4425-402b-b93b-42e4d00833c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3774d89c-140d-4289-aa3d-905627556287', 'volume_name': 'volume-3774d89c-140d-4289-aa3d-905627556287', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd5af5e-958c-4141-8620-5ced059cbbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd5af5e-958c-4141-8620-5ced059cbbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f5017b-89fc-4068-9f71-8a04836d7c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:13 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Volume 3774d89c-140d-4289-aa3d-905627556287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3774d89c-140d-4289-aa3d-905627556287', 'volume_size': 1} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1197943217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3774d89c-140d-4289-aa3d-905627556287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb4e1babaab4f14908e362da2d3c54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:00:13Z,use_quota=True,user_id='794e1b70e3c249b3aa12aeac2abc6714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Creating volume 3774d89c-140d-4289-aa3d-905627556287 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:00:13 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:00:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:13 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287 1073741824 Aug 01 15:00:13 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-65a0def8-df11-4127-bb7a-3c323ec35c71" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-65a0def8-df11-4127-bb7a-3c323ec35c71" acquired by "delete_volume" :: waited 0.057s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c14e9d-45bd-4d2b-a249-8378ebf1c074]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:14 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 Aug 01 15:00:14 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:14 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287 1073741824" returned: 0 in 1.031s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:14 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287 Aug 01 15:00:14 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:15 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71" returned: 0 in 0.867s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:15 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71 Aug 01 15:00:15 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:15 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287" returned: 0 in 0.907s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:00:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f5017b-89fc-4068-9f71-8a04836d7c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3774d89c-140d-4289-aa3d-905627556287', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8653d4-a7bc-4a81-9cbf-cb4fa6df0e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:15 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Volume volume-3774d89c-140d-4289-aa3d-905627556287 (3774d89c-140d-4289-aa3d-905627556287): created successfully Aug 01 15:00:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8653d4-a7bc-4a81-9cbf-cb4fa6df0e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Flow 'volume_create_manager' (3fd8affd-d854-4d37-bab4-30e3ca44378f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:00:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e76c2094-645d-49fe-88ac-802306217bd5 tempest-VolumesAdminNegativeTest-114384449 None] Created volume successfully. Aug 01 15:00:16 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-65a0def8-df11-4127-bb7a-3c323ec35c71" returned: 0 in 0.977s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-65a0def8-df11-4127-bb7a-3c323ec35c71" released by "delete_volume" :: held 2.040s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:16 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Created reservations ['b8b5e3e0-f0e9-4409-b668-b7ffbd0eee95'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:00:16 devstack cinder-volume[89024]: WARNING cinder.db.api [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-325725580'] Aug 01 15:00:16 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Created reservations ['fd5bc01b-0d1a-4f06-b7ab-e0bb7e285744', 'eeefa7f4-88a3-4d7c-b0ca-7b6a336ff205', '4e579861-8040-4657-a0a4-ac1f0f165fd4', '2a10c110-bce0-4a3d-8468-b386c00806c4'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:00:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:00:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:00:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:16 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:00:16 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:17 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.833s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:17 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:00:17 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b1e80676-ebde-4439-b7e3-4fbe0f573e5f tempest-GroupSnapshotsTest-100544624 None] Delete group completed successfully. Aug 01 15:00:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:00:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:00:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:00:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:18 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:00:18 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e9714277-d034-4f7a-9b99-29394e37c50e tempest-GroupSnapshotsTest-100544624 None] Group tempest-GroupSnapshotsTest-Group-154394468: creating Aug 01 15:00:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e9714277-d034-4f7a-9b99-29394e37c50e tempest-GroupSnapshotsTest-100544624 None] Group tempest-GroupSnapshotsTest-Group-154394468: created successfully Aug 01 15:00:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Acquiring lock "cinder-3774d89c-140d-4289-aa3d-905627556287-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e9714277-d034-4f7a-9b99-29394e37c50e tempest-GroupSnapshotsTest-100544624 None] Create group completed successfully. Aug 01 15:00:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Lock "cinder-3774d89c-140d-4289-aa3d-905627556287-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:19 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.897s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:00:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Acquiring lock "cinder-quobyte-3774d89c-140d-4289-aa3d-905627556287" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:00:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 8 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:00:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:00:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Lock "cinder-quobyte-3774d89c-140d-4289-aa3d-905627556287" acquired by "delete_volume" :: waited 0.109s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c4df8a-d280-4312-afef-1442c8ec41f9]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:19 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287 Aug 01 15:00:19 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:20 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287" returned: 0 in 0.727s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:20 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287 Aug 01 15:00:20 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:20 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3774d89c-140d-4289-aa3d-905627556287" returned: 0 in 0.491s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Lock "cinder-quobyte-3774d89c-140d-4289-aa3d-905627556287" released by "delete_volume" :: held 1.339s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:21 devstack cinder-volume[89024]: WARNING cinder.quota [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:00:21 devstack cinder-volume[89024]: WARNING cinder.quota [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Created reservations ['8c9e05f6-9106-4265-a558-7d141492d361', '04d4a0b9-97c6-488f-aace-9fda0392387a', '9e7b0c52-f07c-45bd-989a-1ffabc421bb8', '261ef813-dc20-46c1-8e6c-baae2f8b44e5'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Flow 'volume_create_manager' (31c58360-cdc9-421a-8cd0-b1ca10043a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b592a6a-29e6-46e6-a8f8-078f2dfc318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b592a6a-29e6-46e6-a8f8-078f2dfc318a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-475315483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33713896-3e5a-4b69-849b-f203c5fea217,host='devstack@QuobyteHD#QuobyteHD',id=8fbcd200-6538-41c1-bdd6-c1aff55dd4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4674747124334bc93ff0d5a26bb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:00:21Z,use_quota=True,user_id='c5cfc8dec6b745ad8a091341e4d8d270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6922ca9d-c34c-48e9-bca5-98d4eb265018),volume_type_id=6922ca9d-c34c-48e9-bca5-98d4eb265018)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9560f6d1-c266-4ecf-b8a1-9631a3d544be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9560f6d1-c266-4ecf-b8a1-9631a3d544be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0eef309-7052-4e0f-bbcd-e279006f9ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0eef309-7052-4e0f-bbcd-e279006f9ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fbcd200-6538-41c1-bdd6-c1aff55dd4ee', 'volume_name': 'volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489e045c-e632-4f5d-a803-6de85e02797c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489e045c-e632-4f5d-a803-6de85e02797c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b714c442-a32a-4d60-ad0a-3a56fdc0d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:21 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Volume 8fbcd200-6538-41c1-bdd6-c1aff55dd4ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee', 'volume_size': 1} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=33713896-3e5a-4b69-849b-f203c5fea217,created_at=2026-08-01T13:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-475315483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33713896-3e5a-4b69-849b-f203c5fea217,host='devstack@QuobyteHD#QuobyteHD',id=8fbcd200-6538-41c1-bdd6-c1aff55dd4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4674747124334bc93ff0d5a26bb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:00:21Z,use_quota=True,user_id='c5cfc8dec6b745ad8a091341e4d8d270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6922ca9d-c34c-48e9-bca5-98d4eb265018),volume_type_id=6922ca9d-c34c-48e9-bca5-98d4eb265018)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Creating volume 8fbcd200-6538-41c1-bdd6-c1aff55dd4ee {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:00:21 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:21 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee 1073741824 Aug 01 15:00:21 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:21 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:00:21 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:21 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.435s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:00:21 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Deleted volume successfully. Aug 01 15:00:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcb9d12-1fb6-4508-aa00-eda34a15ed81 tempest-VolumesAdminNegativeTest-114384449 None] Lock "cinder-3774d89c-140d-4289-aa3d-905627556287-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:22 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee 1073741824" returned: 0 in 0.900s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:22 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee Aug 01 15:00:22 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:22 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee" returned: 0 in 0.389s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:00:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b714c442-a32a-4d60-ad0a-3a56fdc0d998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f477d4-3078-4e00-be9a-a3f63b76b01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:22 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Volume volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee (8fbcd200-6538-41c1-bdd6-c1aff55dd4ee): created successfully Aug 01 15:00:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f477d4-3078-4e00-be9a-a3f63b76b01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Flow 'volume_create_manager' (31c58360-cdc9-421a-8cd0-b1ca10043a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:00:22 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-26cc8695-91ec-436c-865d-e823ac2dc38f tempest-GroupSnapshotsTest-100544624 None] Created volume successfully. Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Flow 'volume_create_manager' (c6029cba-7839-4a42-9e56-2a06e7b7a477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ece64ed-c178-4ce4-a9b4-bed69bfcfbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ece64ed-c178-4ce4-a9b4-bed69bfcfbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-36751173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33713896-3e5a-4b69-849b-f203c5fea217,host='devstack@QuobyteHD#QuobyteHD',id=215e5da9-5f3b-4d69-8cf5-130cf82d7178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4674747124334bc93ff0d5a26bb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:00:24Z,use_quota=True,user_id='c5cfc8dec6b745ad8a091341e4d8d270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6922ca9d-c34c-48e9-bca5-98d4eb265018),volume_type_id=6922ca9d-c34c-48e9-bca5-98d4eb265018)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b786630-c792-4323-bcbd-f8f2471fea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b786630-c792-4323-bcbd-f8f2471fea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269dd1c4-237b-49c7-b1d2-7028f6259f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269dd1c4-237b-49c7-b1d2-7028f6259f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215e5da9-5f3b-4d69-8cf5-130cf82d7178', 'volume_name': 'volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56ff7bc-151b-4be3-8a28-0318d77d76cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56ff7bc-151b-4be3-8a28-0318d77d76cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb402dd-3b3d-49f3-91e6-d2a58c365b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:24 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Volume 215e5da9-5f3b-4d69-8cf5-130cf82d7178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178', 'volume_size': 1} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=33713896-3e5a-4b69-849b-f203c5fea217,created_at=2026-08-01T13:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-36751173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33713896-3e5a-4b69-849b-f203c5fea217,host='devstack@QuobyteHD#QuobyteHD',id=215e5da9-5f3b-4d69-8cf5-130cf82d7178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4674747124334bc93ff0d5a26bb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:00:24Z,use_quota=True,user_id='c5cfc8dec6b745ad8a091341e4d8d270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6922ca9d-c34c-48e9-bca5-98d4eb265018),volume_type_id=6922ca9d-c34c-48e9-bca5-98d4eb265018)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Creating volume 215e5da9-5f3b-4d69-8cf5-130cf82d7178 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:00:24 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:24 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 1073741824 Aug 01 15:00:24 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:24 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 1073741824" returned: 0 in 0.676s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:25 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 Aug 01 15:00:25 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:25 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178" returned: 0 in 0.467s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:00:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb402dd-3b3d-49f3-91e6-d2a58c365b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8533241-b25a-4e48-98b1-fa585516ab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:25 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Volume volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 (215e5da9-5f3b-4d69-8cf5-130cf82d7178): created successfully Aug 01 15:00:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8533241-b25a-4e48-98b1-fa585516ab68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Flow 'volume_create_manager' (c6029cba-7839-4a42-9e56-2a06e7b7a477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:00:25 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f193e168-2e29-491d-89fd-12bdd7fc9329 tempest-GroupSnapshotsTest-100544624 None] Created volume successfully. Aug 01 15:00:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fc679e61-58b5-456e-8a26-45446b8eb674 tempest-GroupSnapshotsTest-100544624 None] Update group completed successfully. Aug 01 15:00:28 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f37baba0-08bf-466f-b706-6ae3cc1e7d54 tempest-GroupSnapshotsTest-100544624 None] Update group completed successfully. Aug 01 15:00:29 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c465bcb2-43b2-4e9d-aa00-6251fa63ede0 tempest-GroupSnapshotsTest-100544624 None] Update group completed successfully. Aug 01 15:00:30 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-43dbd230-a3ac-4462-af67-a9037f7b7795 tempest-GroupSnapshotsTest-100544624 None] Update group completed successfully. Aug 01 15:00:32 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] GroupSnapshot 70ce8406-2826-4756-b101-ca7b1b6a3502: creating. Aug 01 15:00:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Group snapshot 70ce8406-2826-4756-b101-ca7b1b6a3502: creating. {{(pid=89024) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 01 15:00:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Creating offline snapshot 546ab713-0132-455b-a40c-e69c186599f5 of volume 215e5da9-5f3b-4d69-8cf5-130cf82d7178 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:00:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b2d508-d7b9-4cca-9cf7-310a610e3386]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:32 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 Aug 01 15:00:32 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:33 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178" returned: 0 in 0.639s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:33 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 1G Aug 01 15:00:33 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:33 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 1G" returned: 0 in 0.547s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:33 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 Aug 01 15:00:33 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:33 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5" returned: 0 in 0.310s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:33 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:00:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:33 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 Aug 01 15:00:33 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:34 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:34 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.info Aug 01 15:00:34 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:34 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.info" returned: 0 in 0.388s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:34 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.info is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:00:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:34 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.info Aug 01 15:00:34 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:34 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.info" returned: 0 in 0.321s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Creating offline snapshot fdabd175-ecbb-4dba-9df0-1b40b582678d of volume 8fbcd200-6538-41c1-bdd6-c1aff55dd4ee {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:00:35 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e1ff22-4815-4598-892b-cd2aaf92e970]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:35 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee Aug 01 15:00:35 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:35 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee" returned: 0 in 0.564s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:35 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d 1G Aug 01 15:00:35 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:36 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d 1G" returned: 0 in 0.768s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:36 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d Aug 01 15:00:36 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:36 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d" returned: 0 in 0.390s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:36 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:00:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:36 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d Aug 01 15:00:36 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:37 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d" returned: 0 in 0.379s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:37 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.info Aug 01 15:00:37 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:37 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.info" returned: 0 in 0.318s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:37 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.info is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:00:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:37 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.info Aug 01 15:00:37 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:37 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.info" returned: 0 in 0.285s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.818s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:37 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-550779c3-1ef7-48b9-a925-769f821c28e9 tempest-GroupSnapshotsTest-100544624 None] group_snapshot 70ce8406-2826-4756-b101-ca7b1b6a3502: created successfully Aug 01 15:00:38 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] group_snapshot 70ce8406-2826-4756-b101-ca7b1b6a3502: deleting Aug 01 15:00:38 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=59,cinder:UPDATE=61,cinder:INSERT=19,cinder:DELETE=3 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:00:38 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=67,cinder:SELECT=81,cinder:DELETE=3,cinder:INSERT=8 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:00:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] group_snapshot 70ce8406-2826-4756-b101-ca7b1b6a3502: deleting {{(pid=89024) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-215e5da9-5f3b-4d69-8cf5-130cf82d7178" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-215e5da9-5f3b-4d69-8cf5-130cf82d7178" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-546ab713-0132-455b-a40c-e69c186599f5" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-546ab713-0132-455b-a40c-e69c186599f5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Deleting offline snapshot 546ab713-0132-455b-a40c-e69c186599f5 of volume 215e5da9-5f3b-4d69-8cf5-130cf82d7178 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] snapshot_file for this snap is: volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63cd1c0-c9aa-4dae-8ea0-dc89827e2306]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:39 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 Aug 01 15:00:39 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:39 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5" returned: 0 in 0.657s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad20d820-c12d-46ae-bebc-5645eb3a986a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:40 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 Aug 01 15:00:40 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:40 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178" returned: 0 in 0.748s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:40 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 Aug 01 15:00:40 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:41 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5" returned: 0 in 0.514s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:41 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5 Aug 01 15:00:41 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:41 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178.546ab713-0132-455b-a40c-e69c186599f5" returned: 0 in 0.384s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-546ab713-0132-455b-a40c-e69c186599f5" released by "_delete_snapshot" :: held 2.475s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-215e5da9-5f3b-4d69-8cf5-130cf82d7178" released by "delete_snapshot" :: held 2.516s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-fdabd175-ecbb-4dba-9df0-1b40b582678d" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-fdabd175-ecbb-4dba-9df0-1b40b582678d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Deleting offline snapshot fdabd175-ecbb-4dba-9df0-1b40b582678d of volume 8fbcd200-6538-41c1-bdd6-c1aff55dd4ee {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] snapshot_file for this snap is: volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d229b273-e1d8-4142-9e4b-c8a59316b4bc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:41 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d Aug 01 15:00:41 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:42 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d" returned: 0 in 0.848s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:00:42 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[67281870-8290-4078-826f-f1920b2146c7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:42 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee Aug 01 15:00:42 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:43 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee" returned: 0 in 0.602s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:43 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d Aug 01 15:00:43 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:44 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d" returned: 0 in 0.799s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:44 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d Aug 01 15:00:44 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:44 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee.fdabd175-ecbb-4dba-9df0-1b40b582678d" returned: 0 in 0.460s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-fdabd175-ecbb-4dba-9df0-1b40b582678d" released by "_delete_snapshot" :: held 2.894s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee" released by "delete_snapshot" :: held 2.928s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:44 devstack cinder-volume[89024]: WARNING cinder.quota [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1547515839 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1547515839, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:00:44 devstack cinder-volume[89024]: WARNING cinder.quota [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1547515839 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1547515839, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:00:44 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Created reservations ['c27893de-eaed-4795-a5e6-56e46e4df841', '5a5f204e-4ef9-4f6f-a9ea-788e73101d92', '84874dea-2f00-4c40-9bba-2ef9062efaaa', '858cf753-ea40-4dbe-a2e0-a7f46fc625e7'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:00:44 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] Created reservations ['c2abe72a-359e-4b29-88cc-d3b3910d4b3f', '85f26c7c-2eeb-4924-bbe3-26e893a5be66', '02e1d8e4-45cb-4ea7-a994-019895f707e9', 'f89b9e06-ba65-4a3b-9d8f-b03ee7eb2ebc'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:00:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-37cd8770-ab04-4366-af86-9a5d38e5a220 tempest-GroupSnapshotsTest-100544624 None] group_snapshot 70ce8406-2826-4756-b101-ca7b1b6a3502: deleted successfully Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Flow 'volume_create_manager' (621d59f1-5b21-4340-8335-b99c31025f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189ca023-40a7-4d87-83ae-a18f3314db81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189ca023-40a7-4d87-83ae-a18f3314db81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1046672033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570a8197-f8c2-42fd-b05a-da8ac9741b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0363e5a5079440728164b4fe7cf05048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:00:45Z,use_quota=True,user_id='ecd30fc985e74ef59934a321d756eb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0437be5f-220c-4c09-9698-b7d8bb0687af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0437be5f-220c-4c09-9698-b7d8bb0687af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9e664a-c54d-4e4a-a15f-37369e98af5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9e664a-c54d-4e4a-a15f-37369e98af5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '570a8197-f8c2-42fd-b05a-da8ac9741b71', 'volume_name': 'volume-570a8197-f8c2-42fd-b05a-da8ac9741b71', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94ab8f5-2cc7-4a4a-ab63-9047e16be60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94ab8f5-2cc7-4a4a-ab63-9047e16be60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48989270-4047-4402-9600-59bd25b86256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:45 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Volume 570a8197-f8c2-42fd-b05a-da8ac9741b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-570a8197-f8c2-42fd-b05a-da8ac9741b71', 'volume_size': 1} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1046672033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570a8197-f8c2-42fd-b05a-da8ac9741b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0363e5a5079440728164b4fe7cf05048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:00:45Z,use_quota=True,user_id='ecd30fc985e74ef59934a321d756eb99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Creating volume 570a8197-f8c2-42fd-b05a-da8ac9741b71 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:00:45 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:00:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:45 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71 1073741824 Aug 01 15:00:45 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:46 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71 1073741824" returned: 0 in 0.703s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-215e5da9-5f3b-4d69-8cf5-130cf82d7178" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-215e5da9-5f3b-4d69-8cf5-130cf82d7178" acquired by "delete_volume" :: waited 0.077s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:46 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71 Aug 01 15:00:46 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:46 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6915dc1-218a-4305-8935-41bf4f8e043a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:46 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 Aug 01 15:00:46 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:46 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71" returned: 0 in 0.476s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:00:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48989270-4047-4402-9600-59bd25b86256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570a8197-f8c2-42fd-b05a-da8ac9741b71', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae278411-2f2b-48a2-b112-cfc2ee0d6ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Volume volume-570a8197-f8c2-42fd-b05a-da8ac9741b71 (570a8197-f8c2-42fd-b05a-da8ac9741b71): created successfully Aug 01 15:00:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae278411-2f2b-48a2-b112-cfc2ee0d6ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Flow 'volume_create_manager' (621d59f1-5b21-4340-8335-b99c31025f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:00:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-9585b43b-799a-41cc-9f75-b9381c7ed334 tempest-DeleteServersTestJSON-982818609 None] Created volume successfully. Aug 01 15:00:47 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178" returned: 0 in 0.593s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:47 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178 Aug 01 15:00:47 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:47 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-215e5da9-5f3b-4d69-8cf5-130cf82d7178" returned: 0 in 0.753s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-215e5da9-5f3b-4d69-8cf5-130cf82d7178" released by "delete_volume" :: held 1.474s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:00:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee" acquired by "delete_volume" :: waited 0.054s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:00:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411e586-89f4-47c8-911c-2c30c2358fa5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:48 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee Aug 01 15:00:48 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:49 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee" returned: 0 in 0.997s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:49 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee Aug 01 15:00:49 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:49 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee" returned: 0 in 0.429s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-8fbcd200-6538-41c1-bdd6-c1aff55dd4ee" released by "delete_volume" :: held 1.588s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:00:49 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Created reservations ['06b64e03-d5a1-49c9-aa4f-15e10d842008'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:00:49 devstack cinder-volume[89024]: WARNING cinder.quota [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1547515839 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1547515839, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:00:49 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Created reservations ['eb6e0fe5-d11d-4c75-a1f9-617ff31a29b4', 'c75d7ae7-bb2e-4cfe-9f6b-4bee8e114aed', '4dbe89da-a169-463a-8030-ec28f1849468', 'c81fdb90-500e-4a3f-9d30-073f31e623e9'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:00:50 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Created reservations ['4a6b1300-88e0-4c08-9302-af4d9b324b9d', '08bdc0b4-8ea6-441d-a4b3-445ad66d56a4', '7ef6107e-b002-42c9-a56e-5fb8b1b7c625', '414e027b-b6f5-4fc9-b9f9-d4622c13840d'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:00:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:00:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:00:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:50 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:00:50 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:50 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.714s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:50 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:00:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-be67f546-9b45-4c2c-9034-6effe650bd6f tempest-GroupSnapshotsTest-100544624 None] Delete group completed successfully. Aug 01 15:00:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d67be7a8-9020-49ee-908f-284c35800ed1 tempest-GroupSnapshotsTest-100544624 None] Group tempest-GroupSnapshotsTest-Group-1282240849: creating Aug 01 15:00:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d67be7a8-9020-49ee-908f-284c35800ed1 tempest-GroupSnapshotsTest-100544624 None] Group tempest-GroupSnapshotsTest-Group-1282240849: created successfully Aug 01 15:00:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d67be7a8-9020-49ee-908f-284c35800ed1 tempest-GroupSnapshotsTest-100544624 None] Create group completed successfully. Aug 01 15:00:52 devstack cinder-volume[89024]: WARNING py.warnings [req-5bb8417c-734b-4038-a269-7074e755ac0e req-05c1b528-ae8b-4bfa-af5e-a1403d63f9fd tempest-TaggedAttachmentsTest-1994664291 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 01 15:00:52 devstack cinder-volume[89024]: .first() Aug 01 15:00:52 devstack cinder-volume[89024]: Aug 01 15:00:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-5bb8417c-734b-4038-a269-7074e755ac0e req-05c1b528-ae8b-4bfa-af5e-a1403d63f9fd tempest-TaggedAttachmentsTest-1994664291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-5bb8417c-734b-4038-a269-7074e755ac0e req-05c1b528-ae8b-4bfa-af5e-a1403d63f9fd tempest-TaggedAttachmentsTest-1994664291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-5bb8417c-734b-4038-a269-7074e755ac0e req-05c1b528-ae8b-4bfa-af5e-a1403d63f9fd tempest-TaggedAttachmentsTest-1994664291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-5bb8417c-734b-4038-a269-7074e755ac0e req-05c1b528-ae8b-4bfa-af5e-a1403d63f9fd tempest-TaggedAttachmentsTest-1994664291 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-08478fcc-71ec-45a5-a397-808ea383f7c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6d0ddc3-7ad2-4db2-8b49-f059381c6497', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:00:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-5bb8417c-734b-4038-a269-7074e755ac0e req-05c1b528-ae8b-4bfa-af5e-a1403d63f9fd tempest-TaggedAttachmentsTest-1994664291 None] attachment_update completed successfully. Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-d99d61f3-f697-46f6-aa15-6992120dd317 req-b2aa49b5-fb69-4e23-a921-705944630193 tempest-DeleteServersTestJSON-982818609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-d99d61f3-f697-46f6-aa15-6992120dd317 req-b2aa49b5-fb69-4e23-a921-705944630193 tempest-DeleteServersTestJSON-982818609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-d99d61f3-f697-46f6-aa15-6992120dd317 req-b2aa49b5-fb69-4e23-a921-705944630193 tempest-DeleteServersTestJSON-982818609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-d99d61f3-f697-46f6-aa15-6992120dd317 req-b2aa49b5-fb69-4e23-a921-705944630193 tempest-DeleteServersTestJSON-982818609 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-570a8197-f8c2-42fd-b05a-da8ac9741b71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19aed5dc-0b0b-4705-be6a-23cebad8d6b4', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:00:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-d99d61f3-f697-46f6-aa15-6992120dd317 req-b2aa49b5-fb69-4e23-a921-705944630193 tempest-DeleteServersTestJSON-982818609 None] attachment_update completed successfully. Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Flow 'volume_create_manager' (fba74a34-6618-41e9-a6f7-b8e08c89c078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082adf40-d512-4be8-b4c2-e63f13381c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082adf40-d512-4be8-b4c2-e63f13381c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-535860834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=257fbc61-6486-4737-bc70-c9b72c27a477,host='devstack@QuobyteHD#QuobyteHD',id=8ff0733f-938f-4339-9970-e333b36fa3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4674747124334bc93ff0d5a26bb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:00:54Z,use_quota=True,user_id='c5cfc8dec6b745ad8a091341e4d8d270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb9873d6-6d10-48e9-ba6d-1ddd08b30c11),volume_type_id=bb9873d6-6d10-48e9-ba6d-1ddd08b30c11)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9da09bf-356c-4f08-96c5-4e7bda6ccb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9da09bf-356c-4f08-96c5-4e7bda6ccb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a938b5-67a8-4fa7-94e1-caf407a19b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a938b5-67a8-4fa7-94e1-caf407a19b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff0733f-938f-4339-9970-e333b36fa3cd', 'volume_name': 'volume-8ff0733f-938f-4339-9970-e333b36fa3cd', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc07e982-a10b-47dd-9276-3c9a3e28ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc07e982-a10b-47dd-9276-3c9a3e28ea48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5215f705-7cda-4a1d-8029-fa30988facc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:53 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Volume 8ff0733f-938f-4339-9970-e333b36fa3cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff0733f-938f-4339-9970-e333b36fa3cd', 'volume_size': 1} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=257fbc61-6486-4737-bc70-c9b72c27a477,created_at=2026-08-01T13:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-535860834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=257fbc61-6486-4737-bc70-c9b72c27a477,host='devstack@QuobyteHD#QuobyteHD',id=8ff0733f-938f-4339-9970-e333b36fa3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e4674747124334bc93ff0d5a26bb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:00:54Z,use_quota=True,user_id='c5cfc8dec6b745ad8a091341e4d8d270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb9873d6-6d10-48e9-ba6d-1ddd08b30c11),volume_type_id=bb9873d6-6d10-48e9-ba6d-1ddd08b30c11)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Creating volume 8ff0733f-938f-4339-9970-e333b36fa3cd {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:00:53 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:00:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:53 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd 1073741824 Aug 01 15:00:53 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:54 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd 1073741824" returned: 0 in 0.600s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:54 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd Aug 01 15:00:54 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:54 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd" returned: 0 in 0.407s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:00:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:00:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5215f705-7cda-4a1d-8029-fa30988facc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff0733f-938f-4339-9970-e333b36fa3cd', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815d468d-0af9-4ee1-9467-5de481b76176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:00:55 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Volume volume-8ff0733f-938f-4339-9970-e333b36fa3cd (8ff0733f-938f-4339-9970-e333b36fa3cd): created successfully Aug 01 15:00:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815d468d-0af9-4ee1-9467-5de481b76176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:00:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Flow 'volume_create_manager' (fba74a34-6618-41e9-a6f7-b8e08c89c078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:00:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-83877df0-9edf-4978-8b3c-4165169409d5 tempest-GroupSnapshotsTest-100544624 None] Created volume successfully. Aug 01 15:00:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] GroupSnapshot 5e2f8dbb-87c4-405f-8fa0-56b2d0f97580: creating. Aug 01 15:00:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] Group snapshot 5e2f8dbb-87c4-405f-8fa0-56b2d0f97580: creating. {{(pid=89024) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 01 15:00:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:00:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:00:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] Creating offline snapshot 7320f4b5-2e67-498a-8572-a5ca3c6d31e7 of volume 8ff0733f-938f-4339-9970-e333b36fa3cd {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:00:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[13825525-9918-47cd-9972-d41b405a7250]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:00:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:56 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd Aug 01 15:00:56 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:57 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd" returned: 0 in 0.666s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:57 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 1G Aug 01 15:00:57 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:58 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-b65f6feb-88b4-4635-ae1c-3a442ff6ed78 req-12aa93d8-69c3-47e4-b97b-5aa1b595c735 tempest-TaggedAttachmentsTest-1994664291 None] Terminate volume connection completed successfully. Aug 01 15:00:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-b65f6feb-88b4-4635-ae1c-3a442ff6ed78 req-12aa93d8-69c3-47e4-b97b-5aa1b595c735 tempest-TaggedAttachmentsTest-1994664291 None] Deleting attachment c6d0ddc3-7ad2-4db2-8b49-f059381c6497. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:00:58 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 1G" returned: 0 in 0.615s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff0733f-938f-4339-9970-e333b36fa3cd -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:58 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff0733f-938f-4339-9970-e333b36fa3cd -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 Aug 01 15:00:58 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:58 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff0733f-938f-4339-9970-e333b36fa3cd -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7" returned: 0 in 0.524s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:58 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:00:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:58 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 Aug 01 15:00:58 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-f91495f8-7f2d-43d8-b855-722d4251e757 req-d1c3a2aa-a644-4466-b273-030e8e0335b1 tempest-DeleteServersTestJSON-982818609 None] Terminate volume connection completed successfully. Aug 01 15:00:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-f91495f8-7f2d-43d8-b855-722d4251e757 req-d1c3a2aa-a644-4466-b273-030e8e0335b1 tempest-DeleteServersTestJSON-982818609 None] Deleting attachment 19aed5dc-0b0b-4705-be6a-23cebad8d6b4. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:00:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7" returned: 0 in 0.488s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:59 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:59 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.info Aug 01 15:00:59 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:00:59 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Aug 01 15:00:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.info" returned: 0 in 0.591s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:00:59 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.info is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:00:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:00:59 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.info Aug 01 15:00:59 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:00 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.info" returned: 0 in 0.427s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.454s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fd453ff6-09b7-4824-83af-0b07c62d719a tempest-GroupSnapshotsTest-100544624 None] group_snapshot 5e2f8dbb-87c4-405f-8fa0-56b2d0f97580: created successfully Aug 01 15:01:01 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] group_snapshot 5e2f8dbb-87c4-405f-8fa0-56b2d0f97580: deleting Aug 01 15:01:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] group_snapshot 5e2f8dbb-87c4-405f-8fa0-56b2d0f97580: deleting {{(pid=89024) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 01 15:01:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-8ff0733f-938f-4339-9970-e333b36fa3cd" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-8ff0733f-938f-4339-9970-e333b36fa3cd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-7320f4b5-2e67-498a-8572-a5ca3c6d31e7" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-7320f4b5-2e67-498a-8572-a5ca3c6d31e7" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Deleting offline snapshot 7320f4b5-2e67-498a-8572-a5ca3c6d31e7 of volume 8ff0733f-938f-4339-9970-e333b36fa3cd {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:01:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] snapshot_file for this snap is: volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:01:01 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[23856dd7-17f4-435a-8594-4115a43be0b2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:01 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 Aug 01 15:01:01 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:02 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7" returned: 0 in 0.519s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ff0733f-938f-4339-9970-e333b36fa3cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:01:02 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[319071c7-72eb-4a6b-ad48-2acd6d94dedd]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:02 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd Aug 01 15:01:02 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:02 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd" returned: 0 in 0.492s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:02 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 Aug 01 15:01:02 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:03 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7" returned: 0 in 0.620s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:03 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7 Aug 01 15:01:03 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Acquiring lock "cinder-570a8197-f8c2-42fd-b05a-da8ac9741b71-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Lock "cinder-570a8197-f8c2-42fd-b05a-da8ac9741b71-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Acquiring lock "cinder-quobyte-570a8197-f8c2-42fd-b05a-da8ac9741b71" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Lock "cinder-quobyte-570a8197-f8c2-42fd-b05a-da8ac9741b71" acquired by "delete_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99bb05b-ead1-4c79-ad76-e6a6a9192804]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:03 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71 Aug 01 15:01:03 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:03 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd.7320f4b5-2e67-498a-8572-a5ca3c6d31e7" returned: 0 in 0.438s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-7320f4b5-2e67-498a-8572-a5ca3c6d31e7" released by "_delete_snapshot" :: held 2.231s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-8ff0733f-938f-4339-9970-e333b36fa3cd" released by "delete_snapshot" :: held 2.284s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:01:03 devstack cinder-volume[89024]: WARNING cinder.quota [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1151087508 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1151087508, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:01:03 devstack cinder-volume[89024]: WARNING cinder.quota [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1151087508 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1151087508, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:01:03 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] Created reservations ['cde7519c-63d6-48ab-a2c5-b0407d3cfe92', '202566c7-0de3-4f92-ab98-417f44d7d2bd', 'a6c0602b-143c-40a5-8e74-44c2241c4de8', '5a016db9-47bc-4073-b135-1b8ea5f11766'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:01:04 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71" returned: 0 in 0.477s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:04 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71 Aug 01 15:01:04 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b020424b-765b-4257-a00b-b2f48c1080e2 tempest-GroupSnapshotsTest-100544624 None] group_snapshot 5e2f8dbb-87c4-405f-8fa0-56b2d0f97580: deleted successfully Aug 01 15:01:04 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-570a8197-f8c2-42fd-b05a-da8ac9741b71" returned: 0 in 0.312s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Lock "cinder-quobyte-570a8197-f8c2-42fd-b05a-da8ac9741b71" released by "delete_volume" :: held 0.861s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Created reservations ['e2b36cb4-8378-419c-83d0-db4b32384da3', '9eb34d58-1051-4b4a-9098-5097bebccf61', 'c02a460a-4865-4b24-8033-e220386262c9', '1bd9ab68-eccc-4a6d-a8e5-23007e7486d2'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:04 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:01:04 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:04 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.289s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:01:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Deleted volume successfully. Aug 01 15:01:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-78c01a8b-0024-468e-b3ac-0aec75a7ba9b tempest-DeleteServersTestJSON-982818609 None] Lock "cinder-570a8197-f8c2-42fd-b05a-da8ac9741b71-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:01:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "cinder-quobyte-8ff0733f-938f-4339-9970-e333b36fa3cd" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-8ff0733f-938f-4339-9970-e333b36fa3cd" acquired by "delete_volume" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee76c36e-7a0f-427d-8c24-d5c251600cf8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:05 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd Aug 01 15:01:05 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:05 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd" returned: 0 in 0.564s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:06 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd Aug 01 15:01:06 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:06 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8ff0733f-938f-4339-9970-e333b36fa3cd" returned: 0 in 0.383s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Lock "cinder-quobyte-8ff0733f-938f-4339-9970-e333b36fa3cd" released by "delete_volume" :: held 1.035s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:01:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Created reservations ['8a68e649-e8ec-4636-a5a1-740b6030c171'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:01:06 devstack cinder-volume[89024]: WARNING cinder.quota [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1151087508 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1151087508, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:01:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Created reservations ['60324dab-60c5-44e6-b332-9e113f9632ee', 'efa91ddf-252b-4aa5-b6c1-3ef9691a0ae5', '6bc556b8-45d0-4163-9252-1a507de228d5', '39b22522-6dfb-452a-a01b-8ffe2e75c1b3'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:01:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:01:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:01:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:06 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:01:06 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:07 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.338s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:07 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:01:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e80672b0-ed73-4872-bf91-dabb429a2d28 tempest-GroupSnapshotsTest-100544624 None] Delete group completed successfully. Aug 01 15:01:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Acquiring lock "cinder-08478fcc-71ec-45a5-a397-808ea383f7c7-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Lock "cinder-08478fcc-71ec-45a5-a397-808ea383f7c7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Acquiring lock "cinder-quobyte-08478fcc-71ec-45a5-a397-808ea383f7c7" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Lock "cinder-quobyte-08478fcc-71ec-45a5-a397-808ea383f7c7" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a4699-5a59-4c60-9638-b61bb964850b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:14 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7 Aug 01 15:01:14 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:14 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7" returned: 0 in 0.585s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:14 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7 Aug 01 15:01:14 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:15 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-08478fcc-71ec-45a5-a397-808ea383f7c7" returned: 0 in 0.270s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Lock "cinder-quobyte-08478fcc-71ec-45a5-a397-808ea383f7c7" released by "delete_volume" :: held 0.916s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Created reservations ['3f5522a8-0aa2-47d5-b53f-ad6f19e07408', '160343fd-2a17-4abe-862a-c53c318ade47', '6beda35b-55a2-4894-bbb5-a573541a7c72', '1950ffc7-079d-4c3c-82cf-4476de8e5c86'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:01:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-05344bdd-6dd8-4475-a976-ef9b2452d543 tempest-GroupSnapshotsV319Test-1230126578 None] Group tempest-GroupSnapshotsV319Test-Group-248123280: creating Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-05344bdd-6dd8-4475-a976-ef9b2452d543 tempest-GroupSnapshotsV319Test-1230126578 None] Group tempest-GroupSnapshotsV319Test-Group-248123280: created successfully Aug 01 15:01:15 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:01:15 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-05344bdd-6dd8-4475-a976-ef9b2452d543 tempest-GroupSnapshotsV319Test-1230126578 None] Create group completed successfully. Aug 01 15:01:15 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.314s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:01:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Deleted volume successfully. Aug 01 15:01:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f6e4c07-b499-4fc9-9f0d-8d2cf1c15c6c tempest-TaggedAttachmentsTest-1994664291 None] Lock "cinder-08478fcc-71ec-45a5-a397-808ea383f7c7-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Flow 'volume_create_manager' (3407a9f2-2738-4e6a-b135-acb55e2e486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0f2973-08dd-4599-b5b6-283eabdbc907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0f2973-08dd-4599-b5b6-283eabdbc907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-811524330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5609faad-2698-41ce-b106-027134ecffe5,host='devstack@QuobyteHD#QuobyteHD',id=848d3ca6-4797-4553-953e-30ef0027365a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9613b5f72a94489a1e5f3c01a31ea55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:01:17Z,use_quota=True,user_id='d04b32820cd44e1ab66bf6539af632d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f479a35d-d58e-4944-abf4-667958fb59bf),volume_type_id=f479a35d-d58e-4944-abf4-667958fb59bf)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dd70a2-03d8-4074-a11d-efab214a9e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dd70a2-03d8-4074-a11d-efab214a9e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cb556e-7068-4fff-bb96-0c2929fcf409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cb556e-7068-4fff-bb96-0c2929fcf409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '848d3ca6-4797-4553-953e-30ef0027365a', 'volume_name': 'volume-848d3ca6-4797-4553-953e-30ef0027365a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d92e769-b3a3-4304-87df-463ff82cc15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d92e769-b3a3-4304-87df-463ff82cc15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d630291-3dcd-406c-90b4-205fa864499d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:17 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Volume 848d3ca6-4797-4553-953e-30ef0027365a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-848d3ca6-4797-4553-953e-30ef0027365a', 'volume_size': 1} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5609faad-2698-41ce-b106-027134ecffe5,created_at=2026-08-01T13:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-811524330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5609faad-2698-41ce-b106-027134ecffe5,host='devstack@QuobyteHD#QuobyteHD',id=848d3ca6-4797-4553-953e-30ef0027365a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9613b5f72a94489a1e5f3c01a31ea55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:01:17Z,use_quota=True,user_id='d04b32820cd44e1ab66bf6539af632d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f479a35d-d58e-4944-abf4-667958fb59bf),volume_type_id=f479a35d-d58e-4944-abf4-667958fb59bf)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Creating volume 848d3ca6-4797-4553-953e-30ef0027365a {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:01:17 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:17 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a 1073741824 Aug 01 15:01:17 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:17 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a 1073741824" returned: 0 in 0.471s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:17 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a Aug 01 15:01:17 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:17 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a" returned: 0 in 0.244s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d630291-3dcd-406c-90b4-205fa864499d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-848d3ca6-4797-4553-953e-30ef0027365a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d967284-9588-4687-803e-1a62d0e3a833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:18 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Volume volume-848d3ca6-4797-4553-953e-30ef0027365a (848d3ca6-4797-4553-953e-30ef0027365a): created successfully Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d967284-9588-4687-803e-1a62d0e3a833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Flow 'volume_create_manager' (3407a9f2-2738-4e6a-b135-acb55e2e486e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:01:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-74923766-b80b-4f0f-94f5-107c53ad3d06 tempest-GroupSnapshotsV319Test-1230126578 None] Created volume successfully. Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] GroupSnapshot d3fad0a3-d215-4729-8dcc-6f9cab86bb3f: creating. Aug 01 15:01:18 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:01:18 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] Group snapshot d3fad0a3-d215-4729-8dcc-6f9cab86bb3f: creating. {{(pid=89024) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] Creating offline snapshot 9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 of volume 848d3ca6-4797-4553-953e-30ef0027365a {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18f11fb-253f-447b-8c00-e7e9bc7ab317]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:18 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a Aug 01 15:01:18 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:19 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.487s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:01:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:01:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 8 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:01:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:01:19 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a" returned: 0 in 0.476s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:19 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 1G Aug 01 15:01:19 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:19 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 1G" returned: 0 in 0.484s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-848d3ca6-4797-4553-953e-30ef0027365a -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:19 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-848d3ca6-4797-4553-953e-30ef0027365a -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 Aug 01 15:01:19 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:20 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-848d3ca6-4797-4553-953e-30ef0027365a -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63" returned: 0 in 0.449s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:20 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:01:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:20 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 Aug 01 15:01:20 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:20 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63" returned: 0 in 0.327s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:20 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.info Aug 01 15:01:20 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:20 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.info" returned: 0 in 0.449s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:20 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:01:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:20 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.info Aug 01 15:01:20 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:21 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.info" returned: 0 in 0.318s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:21 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fe030a59-11c2-4d0e-ae16-d911e8c17530 tempest-GroupSnapshotsV319Test-1230126578 None] group_snapshot d3fad0a3-d215-4729-8dcc-6f9cab86bb3f: created successfully Aug 01 15:01:22 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] group_snapshot d3fad0a3-d215-4729-8dcc-6f9cab86bb3f: deleting Aug 01 15:01:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] group_snapshot d3fad0a3-d215-4729-8dcc-6f9cab86bb3f: deleting {{(pid=89024) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 01 15:01:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Acquiring lock "cinder-quobyte-848d3ca6-4797-4553-953e-30ef0027365a" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Lock "cinder-quobyte-848d3ca6-4797-4553-953e-30ef0027365a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Acquiring lock "cinder-quobyte-9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Lock "cinder-quobyte-9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Deleting offline snapshot 9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 of volume 848d3ca6-4797-4553-953e-30ef0027365a {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:01:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] snapshot_file for this snap is: volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:01:22 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c200842a-0bff-4554-bfd0-39b28f590fa6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:22 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 Aug 01 15:01:22 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:23 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63" returned: 0 in 0.491s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-848d3ca6-4797-4553-953e-30ef0027365a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:01:23 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ac360e-0a7b-47ea-909d-fdf7122d2b07]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:23 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a Aug 01 15:01:23 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:23 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a" returned: 0 in 0.774s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:23 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 Aug 01 15:01:23 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:24 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63" returned: 0 in 0.528s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:24 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63 Aug 01 15:01:24 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:24 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a.9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63" returned: 0 in 0.547s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Lock "cinder-quobyte-9bd4fd97-9b8f-4a30-9ebc-32d6c3410c63" released by "_delete_snapshot" :: held 2.511s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:01:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Lock "cinder-quobyte-848d3ca6-4797-4553-953e-30ef0027365a" released by "delete_snapshot" :: held 2.543s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:01:25 devstack cinder-volume[89024]: WARNING cinder.quota [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1423493026 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1423493026, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:01:25 devstack cinder-volume[89024]: WARNING cinder.quota [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1423493026 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1423493026, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:01:25 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] Created reservations ['e8263ac4-aac2-4e62-b6c4-962af1136a03', '917c4a5e-0e7c-4c33-a010-7be89fba6458', '27912f37-2a0a-4f2f-a4b0-263db94d625e', 'da58db37-b9db-4211-b6c5-9881fca2deb2'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:01:25 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cc74e7c9-46ed-46c2-8078-b14ff9ef57ed tempest-GroupSnapshotsV319Test-1230126578 None] group_snapshot d3fad0a3-d215-4729-8dcc-6f9cab86bb3f: deleted successfully Aug 01 15:01:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Acquiring lock "cinder-quobyte-848d3ca6-4797-4553-953e-30ef0027365a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Lock "cinder-quobyte-848d3ca6-4797-4553-953e-30ef0027365a" acquired by "delete_volume" :: waited 0.042s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:26 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebaf7a4-cab2-4896-93bc-182d4b8c7f83]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:26 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a Aug 01 15:01:26 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:27 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a" returned: 0 in 0.457s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:27 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a Aug 01 15:01:27 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:27 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-848d3ca6-4797-4553-953e-30ef0027365a" returned: 0 in 0.428s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Lock "cinder-quobyte-848d3ca6-4797-4553-953e-30ef0027365a" released by "delete_volume" :: held 0.950s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:01:27 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Created reservations ['a768cd00-f46d-49cb-838f-5e0d0b2f559a'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:01:27 devstack cinder-volume[89024]: WARNING cinder.quota [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1423493026 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1423493026, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:01:27 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Created reservations ['6a545a10-070c-4ef4-96c9-1c701c480d69', '37e3c258-1d66-4d27-b1af-e6698787ddbc', '6690f319-9ca0-41f3-88c8-9c8abde37123', 'a3d1a60d-112f-4e4c-bd71-f45a537045c0'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:01:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:01:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:01:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:28 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:01:28 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:28 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.483s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:28 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:01:28 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1c246951-44d5-4762-8cf0-23b127ff5bf5 tempest-GroupSnapshotsV319Test-1230126578 None] Delete group completed successfully. Aug 01 15:01:37 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=95,cinder:UPDATE=107,cinder:INSERT=24,cinder:DELETE=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:01:37 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=106,cinder:UPDATE=92,cinder:INSERT=24,cinder:DELETE=4 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:01:38 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3d8501e9-8c1b-438c-a2ad-30763e7f07c8 tempest-GroupsV314Test-412368101 None] Group tempest-GroupsV314Test-Group-1071372204: creating Aug 01 15:01:38 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3d8501e9-8c1b-438c-a2ad-30763e7f07c8 tempest-GroupsV314Test-412368101 None] Group tempest-GroupsV314Test-Group-1071372204: created successfully Aug 01 15:01:38 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3d8501e9-8c1b-438c-a2ad-30763e7f07c8 tempest-GroupsV314Test-412368101 None] Create group completed successfully. Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Flow 'volume_create_manager' (567ca323-3eed-4512-b9cf-b86c3481b3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e00b064-d873-4d2b-a898-12b5dd8b393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e00b064-d873-4d2b-a898-12b5dd8b393b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1741905359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73d75fdd-a13d-487b-8cc5-fd5650943db3,host='devstack@QuobyteHD#QuobyteHD',id=6f3b36fa-1888-40cc-80b7-e19eae8a4258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7373df8e759b4a998069e25a7ceff0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:01:40Z,use_quota=True,user_id='343d21b684cd4ca3a7acd6b92c607672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(115b189b-d859-448c-b3c9-401adb5756f8),volume_type_id=115b189b-d859-448c-b3c9-401adb5756f8)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2138fc9-6cde-4e76-a48f-2a4be189947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2138fc9-6cde-4e76-a48f-2a4be189947c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91760f8-5b1e-4b44-9d08-28c2a9816561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91760f8-5b1e-4b44-9d08-28c2a9816561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3b36fa-1888-40cc-80b7-e19eae8a4258', 'volume_name': 'volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad335a83-5f40-4233-b5be-f5653e60020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad335a83-5f40-4233-b5be-f5653e60020a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868db0ca-a290-4a4c-ab66-0c869cc33507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:39 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Volume 6f3b36fa-1888-40cc-80b7-e19eae8a4258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258', 'volume_size': 1} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73d75fdd-a13d-487b-8cc5-fd5650943db3,created_at=2026-08-01T13:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1741905359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73d75fdd-a13d-487b-8cc5-fd5650943db3,host='devstack@QuobyteHD#QuobyteHD',id=6f3b36fa-1888-40cc-80b7-e19eae8a4258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7373df8e759b4a998069e25a7ceff0e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:01:40Z,use_quota=True,user_id='343d21b684cd4ca3a7acd6b92c607672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(115b189b-d859-448c-b3c9-401adb5756f8),volume_type_id=115b189b-d859-448c-b3c9-401adb5756f8)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Creating volume 6f3b36fa-1888-40cc-80b7-e19eae8a4258 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:01:40 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:40 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 1073741824 Aug 01 15:01:40 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:40 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 1073741824" returned: 0 in 0.493s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:40 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 Aug 01 15:01:40 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:40 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258" returned: 0 in 0.309s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868db0ca-a290-4a4c-ab66-0c869cc33507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b850131c-3cd2-4a29-8eb8-320af88baf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:40 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Volume volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 (6f3b36fa-1888-40cc-80b7-e19eae8a4258): created successfully Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b850131c-3cd2-4a29-8eb8-320af88baf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Flow 'volume_create_manager' (567ca323-3eed-4512-b9cf-b86c3481b3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:01:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-899416bb-120f-4d91-990d-6db47db25d95 tempest-GroupsV314Test-412368101 None] Created volume successfully. Aug 01 15:01:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:43 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Cloning volume 6f3b36fa-1888-40cc-80b7-e19eae8a4258 to volume 6552c6b4-8190-4e52-930c-23a76ae2f166 Aug 01 15:01:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Creating offline snapshot a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 of volume 6f3b36fa-1888-40cc-80b7-e19eae8a4258 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:01:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ce1af7-25b7-47ff-bf89-015c6e347112]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:43 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 Aug 01 15:01:43 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:44 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258" returned: 0 in 0.707s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:44 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 1G Aug 01 15:01:44 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:45 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 1G" returned: 0 in 1.111s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:45 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 Aug 01 15:01:45 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:46 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61" returned: 0 in 1.514s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:46 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:01:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:47 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 Aug 01 15:01:47 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:47 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61" returned: 0 in 0.685s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:47 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.info Aug 01 15:01:47 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:48 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.info" returned: 0 in 0.430s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:48 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.info is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:48 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.info Aug 01 15:01:48 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:48 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.info" returned: 0 in 0.309s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Acquiring lock "cinder-quobyte-6552c6b4-8190-4e52-930c-23a76ae2f166" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Lock "cinder-quobyte-6552c6b4-8190-4e52-930c-23a76ae2f166" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] snapshot: a71e3e2b-1c9b-42a5-bc73-df81ffebbb61, volume: 6552c6b4-8190-4e52-930c-23a76ae2f166, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7f4a5f-a4fe-4909-8113-45d31863ee45]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:48 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 Aug 01 15:01:48 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:49 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61" returned: 0 in 0.545s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:01:49 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[226f1764-8d60-4bf5-bbd4-3df1f8217f01]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:01:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:49 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 Aug 01 15:01:49 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:49 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258" returned: 0 in 0.640s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:01:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:01:49 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:01:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:49 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166 Aug 01 15:01:49 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Flow 'volume_create_manager' (5cd2f323-28ca-42ac-9a72-8b0670a02a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07d1857-4810-479b-a70c-647feac64fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07d1857-4810-479b-a70c-647feac64fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2055505753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f196f33-365d-4360-b49d-b62b998f12a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999966be2fc34354b1add21372b973a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:01:53Z,use_quota=True,user_id='aa46190dcf764f95843b449e1a5db8c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86314384-a82a-41f1-ae77-e3ecc3d030a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86314384-a82a-41f1-ae77-e3ecc3d030a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815f30fb-cd5e-4272-8a48-c4b351f93fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815f30fb-cd5e-4272-8a48-c4b351f93fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f196f33-365d-4360-b49d-b62b998f12a5', 'volume_name': 'volume-3f196f33-365d-4360-b49d-b62b998f12a5', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff6a8f1-d755-4c40-ac3e-83d3213869d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff6a8f1-d755-4c40-ac3e-83d3213869d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6949f8-dfb0-4a1d-8e9f-ed99d2ccdff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:01:53 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Volume 3f196f33-365d-4360-b49d-b62b998f12a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f196f33-365d-4360-b49d-b62b998f12a5', 'volume_size': 1} Aug 01 15:01:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:01:59 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166" returned: 0 in 9.606s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:59 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258, size 1024.00 MB, duration 9.61 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:01:59 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Converted 1024.00 MB image at 106.59 MB/s Aug 01 15:01:59 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166 is being set with open permissions: ugo+rw: NotImplementedError Aug 01 15:01:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:01:59 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166 Aug 01 15:01:59 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:01:59 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Aug 01 15:01:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166" returned: 0 in 0.344s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:01:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Lock "cinder-quobyte-6552c6b4-8190-4e52-930c-23a76ae2f166" released by "_copy_volume_from_snapshot" :: held 11.283s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:01:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Acquiring lock "cinder-quobyte-a71e3e2b-1c9b-42a5-bc73-df81ffebbb61" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:01:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Lock "cinder-quobyte-a71e3e2b-1c9b-42a5-bc73-df81ffebbb61" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:01:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Deleting offline snapshot a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 of volume 6f3b36fa-1888-40cc-80b7-e19eae8a4258 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:01:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] snapshot_file for this snap is: volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:02:00 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[51745861-598b-4c1c-b8d0-fed268c5506e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:02:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:00 devstack sudo[91758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 Aug 01 15:02:00 devstack sudo[91758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:00 devstack sudo[91758]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61" returned: 0 in 0.657s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:02:00 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d58865a-2c80-497e-8a68-e9a0ce94badf]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:02:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:00 devstack sudo[91821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 Aug 01 15:02:00 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:01 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258" returned: 0 in 0.696s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:01 devstack sudo[91828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 Aug 01 15:02:01 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:01 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61" returned: 0 in 0.493s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:01 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61 Aug 01 15:02:01 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:02 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258.a71e3e2b-1c9b-42a5-bc73-df81ffebbb61" returned: 0 in 0.349s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Lock "cinder-quobyte-a71e3e2b-1c9b-42a5-bc73-df81ffebbb61" released by "_delete_snapshot" :: held 2.394s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.807s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.455s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2055505753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f196f33-365d-4360-b49d-b62b998f12a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999966be2fc34354b1add21372b973a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:01:53Z,use_quota=True,user_id='aa46190dcf764f95843b449e1a5db8c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Creating volume 3f196f33-365d-4360-b49d-b62b998f12a5 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:02:02 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:02:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:02 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5 1073741824 Aug 01 15:02:02 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-95b68f31-f7f0-4895-98a6-d4faf2d3259f tempest-GroupsV314Test-412368101 None] Create group from source-group-73d75fdd-a13d-487b-8cc5-fd5650943db3 completed successfully. Aug 01 15:02:03 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5 1073741824" returned: 0 in 0.728s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:03 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5 Aug 01 15:02:03 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:03 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5" returned: 0 in 0.483s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6949f8-dfb0-4a1d-8e9f-ed99d2ccdff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f196f33-365d-4360-b49d-b62b998f12a5', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfe9d06-9115-451f-8624-04cbdd900b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Volume volume-3f196f33-365d-4360-b49d-b62b998f12a5 (3f196f33-365d-4360-b49d-b62b998f12a5): created successfully Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfe9d06-9115-451f-8624-04cbdd900b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Flow 'volume_create_manager' (5cd2f323-28ca-42ac-9a72-8b0670a02a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:02:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4db2ec6e-41fb-4922-8b5d-770b03fada70 tempest-AttachVolumeTestJSON-1116048949 None] Created volume successfully. Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Flow 'volume_create_manager' (dea817b7-71df-4db7-a6de-9875e078a01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff8f119-d238-4148-9b42-d1fce3e3225e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff8f119-d238-4148-9b42-d1fce3e3225e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-344467786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984d8852-25a1-4101-8962-5652e3f08553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec6fcb25b73475c8fd2cab6cfa9f604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:02:04Z,use_quota=True,user_id='1a0e21faf8e04bf9b0551e45fabb1c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30d8638-d0ab-4c07-b0b9-533164a43a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30d8638-d0ab-4c07-b0b9-533164a43a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6611aac5-8776-492c-aa91-c0fcddabba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6611aac5-8776-492c-aa91-c0fcddabba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984d8852-25a1-4101-8962-5652e3f08553', 'volume_name': 'volume-984d8852-25a1-4101-8962-5652e3f08553', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff200fc-024f-4975-a52d-a6a49ea421d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff200fc-024f-4975-a52d-a6a49ea421d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068175fe-6c5f-46b9-8fb7-8d173be0914d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:04 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Volume 984d8852-25a1-4101-8962-5652e3f08553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984d8852-25a1-4101-8962-5652e3f08553', 'volume_size': 1} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-344467786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984d8852-25a1-4101-8962-5652e3f08553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ec6fcb25b73475c8fd2cab6cfa9f604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:02:04Z,use_quota=True,user_id='1a0e21faf8e04bf9b0551e45fabb1c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Creating volume 984d8852-25a1-4101-8962-5652e3f08553 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:02:04 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:04 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553 1073741824 Aug 01 15:02:04 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Acquiring lock "cinder-quobyte-6552c6b4-8190-4e52-930c-23a76ae2f166" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Lock "cinder-quobyte-6552c6b4-8190-4e52-930c-23a76ae2f166" acquired by "delete_volume" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca8cd5-ddaa-49cf-94a9-c81d42612ecc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:02:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:04 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166 Aug 01 15:02:04 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:05 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553 1073741824" returned: 0 in 1.020s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:05 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166" returned: 0 in 0.893s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:05 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553 Aug 01 15:02:05 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:05 devstack sudo[91870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166 Aug 01 15:02:05 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:05 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553" returned: 0 in 0.604s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068175fe-6c5f-46b9-8fb7-8d173be0914d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984d8852-25a1-4101-8962-5652e3f08553', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412c690b-8b3c-4970-932e-31b654876cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:05 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Volume volume-984d8852-25a1-4101-8962-5652e3f08553 (984d8852-25a1-4101-8962-5652e3f08553): created successfully Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412c690b-8b3c-4970-932e-31b654876cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Flow 'volume_create_manager' (dea817b7-71df-4db7-a6de-9875e078a01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:02:05 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2c25430b-ec57-42f8-946d-fa47129cd43a tempest-ServerRescueNegativeTestJSON-87665872 None] Created volume successfully. Aug 01 15:02:05 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6552c6b4-8190-4e52-930c-23a76ae2f166" returned: 0 in 0.812s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Lock "cinder-quobyte-6552c6b4-8190-4e52-930c-23a76ae2f166" released by "delete_volume" :: held 1.800s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Created reservations ['1566902a-8006-4f67-aa4c-7fa9213e42f8'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:02:06 devstack cinder-volume[89024]: WARNING cinder.quota [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-698982163 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-698982163, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:02:06 devstack cinder-volume[89024]: WARNING cinder.quota [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-698982163 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-698982163, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Created reservations ['640e502e-4054-4f64-b4d8-488d02738764', '5fb27b8a-e10b-4e9a-9c50-64a217553292', '4cfa093a-f37a-4033-931c-df67989601a2', '61437a24-b26f-4a4a-99a2-f31b75d73982'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-b8cbd67c-9bca-4656-8837-a3652064df56 req-82d9b5a7-1010-4dad-894b-16f2e04ff609 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-b8cbd67c-9bca-4656-8837-a3652064df56 req-82d9b5a7-1010-4dad-894b-16f2e04ff609 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-b8cbd67c-9bca-4656-8837-a3652064df56 req-82d9b5a7-1010-4dad-894b-16f2e04ff609 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.078s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-b8cbd67c-9bca-4656-8837-a3652064df56 req-82d9b5a7-1010-4dad-894b-16f2e04ff609 tempest-AttachVolumeTestJSON-1116048949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-3f196f33-365d-4360-b49d-b62b998f12a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7728053e-520a-4a57-99a1-fa9d95bb4dc3', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:02:07 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:02:07 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-b8cbd67c-9bca-4656-8837-a3652064df56 req-82d9b5a7-1010-4dad-894b-16f2e04ff609 tempest-AttachVolumeTestJSON-1116048949 None] attachment_update completed successfully. Aug 01 15:02:07 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.832s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:07 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:02:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1cc774ed-6849-431c-9616-0ecee621ca40 tempest-GroupsV314Test-412368101 None] Delete group completed successfully. Aug 01 15:02:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Acquiring lock "cinder-quobyte-6f3b36fa-1888-40cc-80b7-e19eae8a4258" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:02:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Lock "cinder-quobyte-6f3b36fa-1888-40cc-80b7-e19eae8a4258" acquired by "delete_volume" :: waited 0.049s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:02:08 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d618ecf8-f2be-401b-a491-05f4e9edaf45]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:02:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:08 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 Aug 01 15:02:08 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:09 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258" returned: 0 in 0.978s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:09 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258 Aug 01 15:02:09 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:09 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6f3b36fa-1888-40cc-80b7-e19eae8a4258" returned: 0 in 0.737s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Lock "cinder-quobyte-6f3b36fa-1888-40cc-80b7-e19eae8a4258" released by "delete_volume" :: held 1.897s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:02:09 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Created reservations ['585b7f64-8771-4483-a928-36aa12a89c98'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:02:10 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Created reservations ['09afbb71-6cfd-4d08-ad7b-1e8a64801791', '5e411a3f-00ed-4a3e-a99d-79e2a7d805f2', 'f3371ee1-e2f1-4363-954f-699984d638bb', '259a3077-d781-4ebe-ad34-1cc4c74a1979'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:02:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:02:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:02:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:02:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:10 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:02:10 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:10 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.450s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:10 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:02:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7db029a7-cec0-45c4-ac22-c468151ddd52 tempest-GroupsV314Test-412368101 None] Delete group completed successfully. Aug 01 15:02:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:02:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:02:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:02:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:02:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:18 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:02:18 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:19 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 1.006s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:02:20 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=38,cinder:INSERT=8,cinder:UPDATE=36,cinder:DELETE=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:02:20 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=37,cinder:UPDATE=37,cinder:DELETE=2,cinder:INSERT=7 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:02:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a70a860d-ee43-435a-a410-f3c48644ad6d tempest-GroupsV320Test-1588039946 None] Group tempest-GroupsV320Test-Group-1456563446: creating Aug 01 15:02:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a70a860d-ee43-435a-a410-f3c48644ad6d tempest-GroupsV320Test-1588039946 None] Group tempest-GroupsV320Test-Group-1456563446: created successfully Aug 01 15:02:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a70a860d-ee43-435a-a410-f3c48644ad6d tempest-GroupsV320Test-1588039946 None] Create group completed successfully. Aug 01 15:02:25 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0ccfad47-6575-4409-a29a-b5d4e62393f4 tempest-GroupsV320Test-1588039946 None] Created reservations ['5ab6ce5a-c5a1-4ab4-8d05-5e95d9add3f6'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:02:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ccfad47-6575-4409-a29a-b5d4e62393f4 tempest-GroupsV320Test-1588039946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:02:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ccfad47-6575-4409-a29a-b5d4e62393f4 tempest-GroupsV320Test-1588039946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0ccfad47-6575-4409-a29a-b5d4e62393f4 tempest-GroupsV320Test-1588039946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:02:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0ccfad47-6575-4409-a29a-b5d4e62393f4 tempest-GroupsV320Test-1588039946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:02:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ccfad47-6575-4409-a29a-b5d4e62393f4 tempest-GroupsV320Test-1588039946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ccfad47-6575-4409-a29a-b5d4e62393f4 tempest-GroupsV320Test-1588039946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:25 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:02:25 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:26 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ccfad47-6575-4409-a29a-b5d4e62393f4 tempest-GroupsV320Test-1588039946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.604s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:26 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-0ccfad47-6575-4409-a29a-b5d4e62393f4 tempest-GroupsV320Test-1588039946 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:02:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0ccfad47-6575-4409-a29a-b5d4e62393f4 tempest-GroupsV320Test-1588039946 None] Delete group completed successfully. Aug 01 15:02:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Acquiring lock "cinder-984d8852-25a1-4101-8962-5652e3f08553-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:02:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Lock "cinder-984d8852-25a1-4101-8962-5652e3f08553-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:02:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Acquiring lock "cinder-quobyte-984d8852-25a1-4101-8962-5652e3f08553" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:02:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Lock "cinder-quobyte-984d8852-25a1-4101-8962-5652e3f08553" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:02:27 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[910eb1d6-fb8f-4115-b1f9-d86b8b8ea42b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:02:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:28 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553 Aug 01 15:02:28 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:28 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553" returned: 0 in 0.637s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:28 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553 Aug 01 15:02:28 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:29 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-984d8852-25a1-4101-8962-5652e3f08553" returned: 0 in 0.489s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Lock "cinder-quobyte-984d8852-25a1-4101-8962-5652e3f08553" released by "delete_volume" :: held 1.204s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Created reservations ['aa5d4f4f-d64a-473b-8de3-29b9c7c79c86', 'eb857c60-c62d-4bf5-befc-9d8522709ee7', '23e059a0-3851-41cb-9027-1a1bf9cd1e03', '967f17fe-fbbd-4d83-8e1e-da42cbefce71'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:29 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:02:29 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:29 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.415s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:02:29 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Deleted volume successfully. Aug 01 15:02:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-244584eb-12ba-49ea-ad21-9aa1ce5e28cd tempest-ServerRescueNegativeTestJSON-87665872 None] Lock "cinder-984d8852-25a1-4101-8962-5652e3f08553-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:02:39 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:02:39 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=12,cinder:SELECT=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:02:43 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:02:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Flow 'volume_create_manager' (2d7f4c9d-1c4f-41c7-96c8-a781ae5519e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:02:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744a8b7f-dfdf-472e-a946-444d44fcd4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744a8b7f-dfdf-472e-a946-444d44fcd4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-662000830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94918afb-c550-42b9-b7d0-a8f2033f775a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb192cfd7a1d48898747da3593dd0c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:02:44Z,use_quota=True,user_id='7f318794dfdd4e089ab88f7ca83f11d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b01ad7f-e1d0-4007-ad35-268d9193bd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b01ad7f-e1d0-4007-ad35-268d9193bd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08c6fb7-663a-4239-bc5d-1d9f5e800258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08c6fb7-663a-4239-bc5d-1d9f5e800258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94918afb-c550-42b9-b7d0-a8f2033f775a', 'volume_name': 'volume-94918afb-c550-42b9-b7d0-a8f2033f775a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb152686-03ec-439d-885c-698c0f9e7a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb152686-03ec-439d-885c-698c0f9e7a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a09a49-2b61-4661-8af6-63a9efba5293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:44 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Volume 94918afb-c550-42b9-b7d0-a8f2033f775a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94918afb-c550-42b9-b7d0-a8f2033f775a', 'volume_size': 1} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-662000830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94918afb-c550-42b9-b7d0-a8f2033f775a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb192cfd7a1d48898747da3593dd0c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:02:44Z,use_quota=True,user_id='7f318794dfdd4e089ab88f7ca83f11d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Creating volume 94918afb-c550-42b9-b7d0-a8f2033f775a {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:02:44 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:44 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a 1073741824 Aug 01 15:02:44 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:44 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a 1073741824" returned: 0 in 0.549s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:02:44 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a Aug 01 15:02:44 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:02:45 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Aug 01 15:02:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:02:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:02:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:02:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a09a49-2b61-4661-8af6-63a9efba5293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94918afb-c550-42b9-b7d0-a8f2033f775a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8751b1f9-c808-45fc-8640-4f11d477efaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:02:45 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Volume volume-94918afb-c550-42b9-b7d0-a8f2033f775a (94918afb-c550-42b9-b7d0-a8f2033f775a): created successfully Aug 01 15:02:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8751b1f9-c808-45fc-8640-4f11d477efaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:02:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Flow 'volume_create_manager' (2d7f4c9d-1c4f-41c7-96c8-a781ae5519e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:02:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a96ba14e-e2e4-4ec5-ad1c-ea69d6abfab9 tempest-ServerActionsTestOtherA-225605167 None] Created volume successfully. Aug 01 15:02:58 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3,cinder:DELETE=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:02:58 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:03:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-b2da36b6-dc52-4860-9654-11366800b25d req-79fed567-87f3-4d88-9e90-dd3e781fe0d3 tempest-AttachVolumeTestJSON-1116048949 None] Terminate volume connection completed successfully. Aug 01 15:03:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-b2da36b6-dc52-4860-9654-11366800b25d req-79fed567-87f3-4d88-9e90-dd3e781fe0d3 tempest-AttachVolumeTestJSON-1116048949 None] Deleting attachment 7728053e-520a-4a57-99a1-fa9d95bb4dc3. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Flow 'volume_create_manager' (22cb1575-a201-4d32-9ef5-c849bc7656d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803e4756-63a0-413f-94f8-e4676d0db1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803e4756-63a0-413f-94f8-e4676d0db1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1277793072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f321d6-bdc9-4a69-9dea-b5caa8c85b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc20e277d3544cba465a3ed1a67a261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:06Z,use_quota=True,user_id='d4a88ab93d3b47f087989a31bf8f4d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2bf7c6-440f-4e31-a5a0-05677b3d8c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2bf7c6-440f-4e31-a5a0-05677b3d8c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef7a61c-db59-4863-8095-a4c3128976e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef7a61c-db59-4863-8095-a4c3128976e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f321d6-bdc9-4a69-9dea-b5caa8c85b1c', 'volume_name': 'volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5d0e73-bc3d-4cb2-8aff-ad9943a11580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e5d0e73-bc3d-4cb2-8aff-ad9943a11580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfbb9b9-1bc4-4551-9ef0-45acc6abf1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:06 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Volume 29f321d6-bdc9-4a69-9dea-b5caa8c85b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c', 'volume_size': 1} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1277793072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f321d6-bdc9-4a69-9dea-b5caa8c85b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc20e277d3544cba465a3ed1a67a261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:06Z,use_quota=True,user_id='d4a88ab93d3b47f087989a31bf8f4d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Creating volume 29f321d6-bdc9-4a69-9dea-b5caa8c85b1c {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:03:06 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:06 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c 1073741824 Aug 01 15:03:06 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:06 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c 1073741824" returned: 0 in 0.471s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:06 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c Aug 01 15:03:06 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c" returned: 0 in 0.608s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:03:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:07 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfbb9b9-1bc4-4551-9ef0-45acc6abf1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e433a5f1-7ed2-4252-a2b2-11b1ea4a1a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:07 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Volume volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c (29f321d6-bdc9-4a69-9dea-b5caa8c85b1c): created successfully Aug 01 15:03:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e433a5f1-7ed2-4252-a2b2-11b1ea4a1a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Flow 'volume_create_manager' (22cb1575-a201-4d32-9ef5-c849bc7656d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7c7992c2-3934-42f8-ac7a-f739d8aca0e8 tempest-VolumesListAdminTestJSON-689724032 None] Created volume successfully. Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Flow 'volume_create_manager' (566c476c-db6b-45d0-b942-e8b8feafb053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad150d06-1bc9-47f1-b195-58e7d4d14862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad150d06-1bc9-47f1-b195-58e7d4d14862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1274526636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ce4499-0cce-4fd5-9b1f-3022750dc784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc20e277d3544cba465a3ed1a67a261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:09Z,use_quota=True,user_id='d4a88ab93d3b47f087989a31bf8f4d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc675d43-e251-4a1f-8136-e06541550b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc675d43-e251-4a1f-8136-e06541550b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36ddb34-8307-427a-9157-e90d35f54f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36ddb34-8307-427a-9157-e90d35f54f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ce4499-0cce-4fd5-9b1f-3022750dc784', 'volume_name': 'volume-31ce4499-0cce-4fd5-9b1f-3022750dc784', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eac7859-121e-4dd0-853f-63a1d6fadab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eac7859-121e-4dd0-853f-63a1d6fadab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3619be9f-2b0b-42c3-a8ca-bb28d3a3a8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:09 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Volume 31ce4499-0cce-4fd5-9b1f-3022750dc784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ce4499-0cce-4fd5-9b1f-3022750dc784', 'volume_size': 1} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1274526636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ce4499-0cce-4fd5-9b1f-3022750dc784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc20e277d3544cba465a3ed1a67a261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:09Z,use_quota=True,user_id='d4a88ab93d3b47f087989a31bf8f4d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Creating volume 31ce4499-0cce-4fd5-9b1f-3022750dc784 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:03:09 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:03:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:09 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784 1073741824 Aug 01 15:03:09 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:10 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784 1073741824" returned: 0 in 0.702s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:10 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784 Aug 01 15:03:10 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:10 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784" returned: 0 in 0.369s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:03:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3619be9f-2b0b-42c3-a8ca-bb28d3a3a8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ce4499-0cce-4fd5-9b1f-3022750dc784', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a013d7-0436-49e5-a1ca-80a94c49b549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:10 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Volume volume-31ce4499-0cce-4fd5-9b1f-3022750dc784 (31ce4499-0cce-4fd5-9b1f-3022750dc784): created successfully Aug 01 15:03:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a013d7-0436-49e5-a1ca-80a94c49b549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Flow 'volume_create_manager' (566c476c-db6b-45d0-b942-e8b8feafb053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c1295bf6-1335-4662-8558-3796ded693ac tempest-VolumesListAdminTestJSON-689724032 None] Created volume successfully. Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Flow 'volume_create_manager' (643d3f32-e7a0-4dc1-bdd6-a0077864edf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be87693c-7a0f-4bac-89a9-10e1470a18f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be87693c-7a0f-4bac-89a9-10e1470a18f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-917116768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479ad3ba-a5a4-4aaa-80b1-7bb9001a376b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc20e277d3544cba465a3ed1a67a261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:13Z,use_quota=True,user_id='d4a88ab93d3b47f087989a31bf8f4d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea694111-d295-4eb6-a0a7-e1eac61d8d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea694111-d295-4eb6-a0a7-e1eac61d8d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21928832-bc26-459a-8937-cb75006da028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21928832-bc26-459a-8937-cb75006da028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479ad3ba-a5a4-4aaa-80b1-7bb9001a376b', 'volume_name': 'volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8b698b-3970-48cf-98a2-a3fa0773eff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8b698b-3970-48cf-98a2-a3fa0773eff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b6bae5-4bbd-464b-81ff-c1c5b86005de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:12 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Volume 479ad3ba-a5a4-4aaa-80b1-7bb9001a376b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b', 'volume_size': 1} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-917116768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479ad3ba-a5a4-4aaa-80b1-7bb9001a376b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc20e277d3544cba465a3ed1a67a261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:13Z,use_quota=True,user_id='d4a88ab93d3b47f087989a31bf8f4d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Creating volume 479ad3ba-a5a4-4aaa-80b1-7bb9001a376b {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:03:12 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:03:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:12 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b 1073741824 Aug 01 15:03:12 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:13 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b 1073741824" returned: 0 in 0.669s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:13 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b Aug 01 15:03:13 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:14 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:03:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b6bae5-4bbd-464b-81ff-c1c5b86005de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47381b1-13e9-424f-af73-5dcc3734201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:14 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Volume volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b (479ad3ba-a5a4-4aaa-80b1-7bb9001a376b): created successfully Aug 01 15:03:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47381b1-13e9-424f-af73-5dcc3734201e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Flow 'volume_create_manager' (643d3f32-e7a0-4dc1-bdd6-a0077864edf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:14 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5bfc54fd-649d-48b8-a9a1-2edfdebf3990 tempest-VolumesListAdminTestJSON-689724032 None] Created volume successfully. Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Flow 'volume_create_manager' (461f0a41-bb34-4366-b4a4-967522cbbc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d50b13-3748-4723-8407-77ebd1b5f160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d50b13-3748-4723-8407-77ebd1b5f160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f1e46e-b9b5-475e-aa6f-ab0674a088ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883fee16fa9f40e185f6da43c1ad75a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:16Z,use_quota=True,user_id='1874fe87ba8d4f84b2ca307be346f275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f5c570-e8e9-46c3-ab5a-39d94ff8ed9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f5c570-e8e9-46c3-ab5a-39d94ff8ed9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b508c4-f0f4-4ddc-b15a-2913186a8064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b508c4-f0f4-4ddc-b15a-2913186a8064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f1e46e-b9b5-475e-aa6f-ab0674a088ba', 'volume_name': 'volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fee325c-d61d-4244-8c3e-2d204e3c5af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fee325c-d61d-4244-8c3e-2d204e3c5af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e63391-4f5d-4030-983a-850de8eae54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:16 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Volume 49f1e46e-b9b5-475e-aa6f-ab0674a088ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba', 'volume_size': 1} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f1e46e-b9b5-475e-aa6f-ab0674a088ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883fee16fa9f40e185f6da43c1ad75a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:16Z,use_quota=True,user_id='1874fe87ba8d4f84b2ca307be346f275',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Creating volume 49f1e46e-b9b5-475e-aa6f-ab0674a088ba {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:03:16 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:03:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:16 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba 1073741824 Aug 01 15:03:16 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:17 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba 1073741824" returned: 0 in 1.367s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:17 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba Aug 01 15:03:17 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:18 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba" returned: 0 in 0.425s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e63391-4f5d-4030-983a-850de8eae54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263e91ec-e4b5-4eec-b510-0bc9ad4efed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:18 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Volume volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba (49f1e46e-b9b5-475e-aa6f-ab0674a088ba): created successfully Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263e91ec-e4b5-4eec-b510-0bc9ad4efed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Flow 'volume_create_manager' (461f0a41-bb34-4366-b4a4-967522cbbc45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-83262cee-9ad5-4802-8972-37fc6c25064e tempest-VolumesListAdminTestJSON-2101517339 None] Created volume successfully. Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:18 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:03:18 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:18 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 8 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:03:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:03:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Acquiring lock "cinder-49f1e46e-b9b5-475e-aa6f-ab0674a088ba-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Lock "cinder-49f1e46e-b9b5-475e-aa6f-ab0674a088ba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Acquiring lock "cinder-quobyte-49f1e46e-b9b5-475e-aa6f-ab0674a088ba" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Lock "cinder-quobyte-49f1e46e-b9b5-475e-aa6f-ab0674a088ba" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ad3c0-978f-4ad7-b692-70ca860dee76]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:03:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:19 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba Aug 01 15:03:19 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "cinder-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "cinder-quobyte-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-quobyte-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b" acquired by "delete_volume" :: waited 0.035s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:20 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd253e7-f050-4205-84d2-15b7d7425d7c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:03:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:20 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b Aug 01 15:03:20 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:20 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba" returned: 0 in 0.855s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:20 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba Aug 01 15:03:20 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:21 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b" returned: 0 in 1.184s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:21 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b Aug 01 15:03:21 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:21 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-49f1e46e-b9b5-475e-aa6f-ab0674a088ba" returned: 0 in 1.357s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Lock "cinder-quobyte-49f1e46e-b9b5-475e-aa6f-ab0674a088ba" released by "delete_volume" :: held 2.309s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Created reservations ['4dc96427-bd93-4038-b4ce-4bdb74f96dbd', 'c34f8d4d-a4b7-499d-8ba0-b18e2c5269ea', 'b0732aaa-79f4-43eb-bf96-7372dd6a9224', '4e1bbc2f-a995-4e85-a48e-05f64e1f8843'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:03:22 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b" returned: 0 in 0.853s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-quobyte-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b" released by "delete_volume" :: held 2.118s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:22 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:03:22 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Created reservations ['cfbcca70-dbec-4501-b630-117479d2aa3c', '826a0636-2e34-4b49-8f43-6ba0acacb374', '3d1475d7-6bd9-43b0-8ea4-8bbb30ec1b77', 'a34787d4-ea78-41ba-a926-1a5297c362a4'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:03:22 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.579s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:22 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Deleted volume successfully. Aug 01 15:03:22 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:03:22 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b7298577-612d-4971-8916-12a35870c9d6 tempest-VolumesListAdminTestJSON-2101517339 None] Lock "cinder-49f1e46e-b9b5-475e-aa6f-ab0674a088ba-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:23 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.402s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:23 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:03:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Deleted volume successfully. Aug 01 15:03:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-067f6194-a7ee-41a6-aec9-cbde03b9d993 tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-479ad3ba-a5a4-4aaa-80b1-7bb9001a376b-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "cinder-31ce4499-0cce-4fd5-9b1f-3022750dc784-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-31ce4499-0cce-4fd5-9b1f-3022750dc784-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "cinder-quobyte-31ce4499-0cce-4fd5-9b1f-3022750dc784" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-quobyte-31ce4499-0cce-4fd5-9b1f-3022750dc784" acquired by "delete_volume" :: waited 0.042s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:24 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31efeef-c894-412c-bbab-725d73abc967]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:03:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:24 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784 Aug 01 15:03:24 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:24 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784" returned: 0 in 0.696s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:24 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784 Aug 01 15:03:24 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:25 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31ce4499-0cce-4fd5-9b1f-3022750dc784" returned: 0 in 0.489s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-quobyte-31ce4499-0cce-4fd5-9b1f-3022750dc784" released by "delete_volume" :: held 1.296s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Created reservations ['26993411-bc8e-4f37-a69b-ab7ba28eef96', 'c3fe8948-c37d-4cef-b7ac-47479a45e471', '9165a1b8-f8ee-428b-a910-28ed25ff56c8', '08362140-4a9f-4daf-8fe0-c356dd8c0c66'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-37233967-1bc1-4501-b6c6-e64a6021ff57 req-7ae5df84-4b45-4cc5-93ce-2d0694d9db8c tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-37233967-1bc1-4501-b6c6-e64a6021ff57 req-7ae5df84-4b45-4cc5-93ce-2d0694d9db8c tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-37233967-1bc1-4501-b6c6-e64a6021ff57 req-7ae5df84-4b45-4cc5-93ce-2d0694d9db8c tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.074s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-37233967-1bc1-4501-b6c6-e64a6021ff57 req-7ae5df84-4b45-4cc5-93ce-2d0694d9db8c tempest-ServerActionsTestOtherA-225605167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-94918afb-c550-42b9-b7d0-a8f2033f775a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5c40125-97a3-4849-a10e-bd516b62a15f', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:25 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:03:25 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-37233967-1bc1-4501-b6c6-e64a6021ff57 req-7ae5df84-4b45-4cc5-93ce-2d0694d9db8c tempest-ServerActionsTestOtherA-225605167 None] attachment_update completed successfully. Aug 01 15:03:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "cinder-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:26 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.715s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:26 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:03:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Deleted volume successfully. Aug 01 15:03:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4932b869-b1bb-4060-aae7-64ebe3775b55 tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-31ce4499-0cce-4fd5-9b1f-3022750dc784-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "cinder-quobyte-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-quobyte-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c" acquired by "delete_volume" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:26 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ef955a-510e-47e2-a992-2333f6104984]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:03:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:26 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c Aug 01 15:03:26 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:27 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c" returned: 0 in 0.811s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:27 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c Aug 01 15:03:27 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:28 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c" returned: 0 in 0.505s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-quobyte-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c" released by "delete_volume" :: held 1.380s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Created reservations ['c15b2fe9-8dab-4b40-aaf3-bf3cb4e2c829', '797caa96-6221-4e4e-80e6-a5514906fad7', '0ca9ebb4-ed99-4c3b-ac28-9d3694dd44a4', '8245af95-853b-4f04-9252-ccc4ec7f855f'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:28 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:03:28 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:28 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.497s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:03:28 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Deleted volume successfully. Aug 01 15:03:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-345761d3-ff3f-42c3-96a0-32a5f4470b6e tempest-VolumesListAdminTestJSON-689724032 None] Lock "cinder-29f321d6-bdc9-4a69-9dea-b5caa8c85b1c-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:31 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-1f42eaf5-a134-4cd1-883d-84211e14cc7e req-628a319d-91ec-42d3-92c4-029a957e830a tempest-ServerActionsTestOtherA-225605167 None] Terminate volume connection completed successfully. Aug 01 15:03:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-1f42eaf5-a134-4cd1-883d-84211e14cc7e req-628a319d-91ec-42d3-92c4-029a957e830a tempest-ServerActionsTestOtherA-225605167 None] Deleting attachment d5c40125-97a3-4849-a10e-bd516b62a15f. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:03:31 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:03:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Flow 'volume_create_manager' (e89a3217-cf64-4d34-a1a3-93c9b581b6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40eba0c1-940e-451d-bead-7d9f693447b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40eba0c1-940e-451d-bead-7d9f693447b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-541742939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da0a22b-49fb-456c-8a3d-6e91f92fb926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffd0fe6c090460e96e936f0adc050ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:32Z,use_quota=True,user_id='c00e4ec0ac844a83b85d1b05f46018b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6368ec-b83c-46e6-bef8-db33d132bb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6368ec-b83c-46e6-bef8-db33d132bb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a136fdd5-a84c-4b1f-9ec1-03e3304f9ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a136fdd5-a84c-4b1f-9ec1-03e3304f9ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da0a22b-49fb-456c-8a3d-6e91f92fb926', 'volume_name': 'volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988b4ee5-a941-46fa-b60f-f0f9d34f91ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (988b4ee5-a941-46fa-b60f-f0f9d34f91ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbbd815-b134-451d-8224-7b85e8810b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:32 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Volume 7da0a22b-49fb-456c-8a3d-6e91f92fb926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926', 'volume_size': 1} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-541742939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da0a22b-49fb-456c-8a3d-6e91f92fb926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffd0fe6c090460e96e936f0adc050ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:32Z,use_quota=True,user_id='c00e4ec0ac844a83b85d1b05f46018b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Creating volume 7da0a22b-49fb-456c-8a3d-6e91f92fb926 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:03:32 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:32 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926 1073741824 Aug 01 15:03:32 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:32 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926 1073741824" returned: 0 in 0.640s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1f42eaf5-a134-4cd1-883d-84211e14cc7e req-cef2e15a-0721-45f7-a10f-d9e8a99a7c13 tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:32 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926 Aug 01 15:03:32 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:33 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926" returned: 0 in 0.280s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:03:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1f42eaf5-a134-4cd1-883d-84211e14cc7e req-cef2e15a-0721-45f7-a10f-d9e8a99a7c13 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.311s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbbd815-b134-451d-8224-7b85e8810b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f540e81e-68d8-4cb7-8b19-44049f33a405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1f42eaf5-a134-4cd1-883d-84211e14cc7e req-cef2e15a-0721-45f7-a10f-d9e8a99a7c13 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:33 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Volume volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926 (7da0a22b-49fb-456c-8a3d-6e91f92fb926): created successfully Aug 01 15:03:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f540e81e-68d8-4cb7-8b19-44049f33a405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Flow 'volume_create_manager' (e89a3217-cf64-4d34-a1a3-93c9b581b6a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:33 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-98a63c0f-f382-43df-82e7-718dfc9cf0b1 tempest-ServersNegativeTestJSON-828307058 None] Created volume successfully. Aug 01 15:03:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-1f42eaf5-a134-4cd1-883d-84211e14cc7e req-cef2e15a-0721-45f7-a10f-d9e8a99a7c13 tempest-ServerActionsTestOtherA-225605167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-94918afb-c550-42b9-b7d0-a8f2033f775a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4c5da17-8e1d-4596-939a-9c69d5c48ca6', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:03:33 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-1f42eaf5-a134-4cd1-883d-84211e14cc7e req-cef2e15a-0721-45f7-a10f-d9e8a99a7c13 tempest-ServerActionsTestOtherA-225605167 None] attachment_update completed successfully. Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Flow 'volume_create_manager' (d2dd4a64-7fa9-4c6a-8c79-59f8c0261014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429188db-cc02-495e-ad92-c17ff8098811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429188db-cc02-495e-ad92-c17ff8098811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1396624750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4424bc83-1be4-4b32-977e-742e5ec821d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffd0fe6c090460e96e936f0adc050ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:36Z,use_quota=True,user_id='c00e4ec0ac844a83b85d1b05f46018b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2911d44-caf7-4a75-bc80-87fee832252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2911d44-caf7-4a75-bc80-87fee832252d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d4d4c1-d81f-4e4a-9a45-a4488c2a6062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d4d4c1-d81f-4e4a-9a45-a4488c2a6062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4424bc83-1be4-4b32-977e-742e5ec821d2', 'volume_name': 'volume-4424bc83-1be4-4b32-977e-742e5ec821d2', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994d7aeb-1b8b-42f8-aa84-ac4b962900b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (994d7aeb-1b8b-42f8-aa84-ac4b962900b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300b2711-0440-4b8a-b9b8-5f5fc6aa52a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:36 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Volume 4424bc83-1be4-4b32-977e-742e5ec821d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4424bc83-1be4-4b32-977e-742e5ec821d2', 'volume_size': 1} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1396624750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4424bc83-1be4-4b32-977e-742e5ec821d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ffd0fe6c090460e96e936f0adc050ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:36Z,use_quota=True,user_id='c00e4ec0ac844a83b85d1b05f46018b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Creating volume 4424bc83-1be4-4b32-977e-742e5ec821d2 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:03:36 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:36 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2 1073741824 Aug 01 15:03:36 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:36 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2 1073741824" returned: 0 in 0.579s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:36 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2 Aug 01 15:03:36 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:37 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2" returned: 0 in 0.301s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:03:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300b2711-0440-4b8a-b9b8-5f5fc6aa52a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4424bc83-1be4-4b32-977e-742e5ec821d2', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e1476b-816c-41cb-a978-6264779fc551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:37 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Volume volume-4424bc83-1be4-4b32-977e-742e5ec821d2 (4424bc83-1be4-4b32-977e-742e5ec821d2): created successfully Aug 01 15:03:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e1476b-816c-41cb-a978-6264779fc551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Flow 'volume_create_manager' (d2dd4a64-7fa9-4c6a-8c79-59f8c0261014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:37 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-29cc322f-4704-47fd-84b1-7bba9bd1c4c9 tempest-ServersNegativeTestJSON-828307058 None] Created volume successfully. Aug 01 15:03:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Acquiring lock "cinder-4424bc83-1be4-4b32-977e-742e5ec821d2-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Lock "cinder-4424bc83-1be4-4b32-977e-742e5ec821d2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Acquiring lock "cinder-quobyte-4424bc83-1be4-4b32-977e-742e5ec821d2" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Lock "cinder-quobyte-4424bc83-1be4-4b32-977e-742e5ec821d2" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:39 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f038be-cf7b-478f-9926-9578aa22dc1b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:03:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:39 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2 Aug 01 15:03:39 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:39 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2" returned: 0 in 0.550s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:39 devstack sudo[94817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2 Aug 01 15:03:39 devstack sudo[94817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:40 devstack sudo[94817]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4424bc83-1be4-4b32-977e-742e5ec821d2" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Lock "cinder-quobyte-4424bc83-1be4-4b32-977e-742e5ec821d2" released by "delete_volume" :: held 0.976s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Created reservations ['5834dd25-cab8-4c19-970d-d905ec9a9369', '3abcea22-266f-462c-82cd-39c2eef9236b', 'ca58f9bb-7f61-40b9-82f4-1518a40c04f3', '807d94f8-5bba-438a-bc5e-801ce4c4518f'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:40 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:03:40 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:40 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.337s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:03:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Deleted volume successfully. Aug 01 15:03:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecee73c1-0d07-4f94-a615-2652e6010b3e tempest-ServersNegativeTestJSON-828307058 None] Lock "cinder-4424bc83-1be4-4b32-977e-742e5ec821d2-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Acquiring lock "cinder-7da0a22b-49fb-456c-8a3d-6e91f92fb926-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Lock "cinder-7da0a22b-49fb-456c-8a3d-6e91f92fb926-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Acquiring lock "cinder-quobyte-7da0a22b-49fb-456c-8a3d-6e91f92fb926" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Lock "cinder-quobyte-7da0a22b-49fb-456c-8a3d-6e91f92fb926" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[00541301-844b-44c9-ae5d-0fc6964c905a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:03:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:41 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926 Aug 01 15:03:41 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:41 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926" returned: 0 in 0.374s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:41 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926 Aug 01 15:03:41 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:03:42 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Flow 'volume_create_manager' (d9ebc643-ffa6-4554-b5a6-5dbfd1e0ac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5716c6-0f6d-430f-b397-fa1942637818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7da0a22b-49fb-456c-8a3d-6e91f92fb926" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Lock "cinder-quobyte-7da0a22b-49fb-456c-8a3d-6e91f92fb926" released by "delete_volume" :: held 0.775s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5716c6-0f6d-430f-b397-fa1942637818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-243434958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535e8d8c-3ede-4836-b85e-ab874cbda58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe414e222cd34e4ea16d37376681be25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:42Z,use_quota=True,user_id='f628e523d89e4379a7bdf33457976128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dc1c91-84fb-4dcb-9394-a7c99cafb2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dc1c91-84fb-4dcb-9394-a7c99cafb2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a83e1af-5aa5-4746-a9f5-1609696c6803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a83e1af-5aa5-4746-a9f5-1609696c6803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535e8d8c-3ede-4836-b85e-ab874cbda58a', 'volume_name': 'volume-535e8d8c-3ede-4836-b85e-ab874cbda58a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b3541a-416e-4712-8991-51c415103bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b3541a-416e-4712-8991-51c415103bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3227f97-da05-4a6e-ab49-73e6246f6239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:42 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Volume 535e8d8c-3ede-4836-b85e-ab874cbda58a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535e8d8c-3ede-4836-b85e-ab874cbda58a', 'volume_size': 1} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-243434958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535e8d8c-3ede-4836-b85e-ab874cbda58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe414e222cd34e4ea16d37376681be25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:42Z,use_quota=True,user_id='f628e523d89e4379a7bdf33457976128',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Creating volume 535e8d8c-3ede-4836-b85e-ab874cbda58a {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:03:42 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:42 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a 1073741824 Aug 01 15:03:42 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Created reservations ['83d6e5c0-87bb-4c22-9877-498e0b27ef74', '13d24927-9476-4edd-80fd-97c7daf6fbfe', '5a435fd0-fc6c-4650-a3d1-850731bc2287', '2b75c0bb-ea89-40c4-ab7a-71c6d9c870b0'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:42 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:03:42 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:42 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:03:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Deleted volume successfully. Aug 01 15:03:42 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-16e0d92d-20c3-44b2-ba5d-083ea39ca517 tempest-ServersNegativeTestJSON-828307058 None] Lock "cinder-7da0a22b-49fb-456c-8a3d-6e91f92fb926-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a 1073741824" returned: 0 in 0.541s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:42 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a Aug 01 15:03:42 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:43 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a" returned: 0 in 0.323s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:03:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3227f97-da05-4a6e-ab49-73e6246f6239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535e8d8c-3ede-4836-b85e-ab874cbda58a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c136c56-98c3-40b3-a36c-93d21700948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:43 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Volume volume-535e8d8c-3ede-4836-b85e-ab874cbda58a (535e8d8c-3ede-4836-b85e-ab874cbda58a): created successfully Aug 01 15:03:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c136c56-98c3-40b3-a36c-93d21700948e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Flow 'volume_create_manager' (d9ebc643-ffa6-4554-b5a6-5dbfd1e0ac62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-79ac108a-5481-434f-9f94-1090151c2d59 tempest-VolumesMetadataTest-75514904 None] Created volume successfully. Aug 01 15:03:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Acquiring lock "cinder-535e8d8c-3ede-4836-b85e-ab874cbda58a-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Lock "cinder-535e8d8c-3ede-4836-b85e-ab874cbda58a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Acquiring lock "cinder-quobyte-535e8d8c-3ede-4836-b85e-ab874cbda58a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Lock "cinder-quobyte-535e8d8c-3ede-4836-b85e-ab874cbda58a" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:45 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[29061cb6-b0b6-4252-b764-87156c81e628]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:03:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:45 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a Aug 01 15:03:45 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:45 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a" returned: 0 in 0.369s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:45 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a Aug 01 15:03:45 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:46 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-535e8d8c-3ede-4836-b85e-ab874cbda58a" returned: 0 in 0.286s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Lock "cinder-quobyte-535e8d8c-3ede-4836-b85e-ab874cbda58a" released by "delete_volume" :: held 0.715s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Created reservations ['d577af0e-9ae6-48b5-ae3c-61659e4b3983', 'b035e120-12b5-414c-9764-3de691ad68e7', '85257838-5bb9-4201-91b7-86846b0de07f', '4fd2fdcd-f364-4899-92d7-7227a200ce95'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:46 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:03:46 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:46 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.496s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:03:46 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Deleted volume successfully. Aug 01 15:03:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da37ddbf-e6a3-4cce-8d49-c216a2fac9e6 tempest-VolumesMetadataTest-75514904 None] Lock "cinder-535e8d8c-3ede-4836-b85e-ab874cbda58a-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Flow 'volume_create_manager' (8c0e1cb7-33df-4342-95b8-f4ac65445283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1543f7-2414-40fc-9efc-159f6e056166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1543f7-2414-40fc-9efc-159f6e056166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-997268008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826eef75-e6d5-4bff-bdaa-2386f7e981af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c08d1e26834afd9fff9bdde2a8925b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:52Z,use_quota=True,user_id='5b1e2693e18a4062b80bc66088f293e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340479f6-1918-4835-a513-da3c4aa7f5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340479f6-1918-4835-a513-da3c4aa7f5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a84ed2-dfa0-4081-96f4-170d8830db12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a84ed2-dfa0-4081-96f4-170d8830db12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826eef75-e6d5-4bff-bdaa-2386f7e981af', 'volume_name': 'volume-826eef75-e6d5-4bff-bdaa-2386f7e981af', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18124ad5-3364-4614-853f-5b0f3465c156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18124ad5-3364-4614-853f-5b0f3465c156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad7608d-ff77-41a8-bb3d-84b617ccd52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Volume 826eef75-e6d5-4bff-bdaa-2386f7e981af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826eef75-e6d5-4bff-bdaa-2386f7e981af', 'volume_size': 1} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-997268008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826eef75-e6d5-4bff-bdaa-2386f7e981af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c08d1e26834afd9fff9bdde2a8925b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:52Z,use_quota=True,user_id='5b1e2693e18a4062b80bc66088f293e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Creating volume 826eef75-e6d5-4bff-bdaa-2386f7e981af {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:03:52 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:03:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:52 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af 1073741824 Aug 01 15:03:52 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:53 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af 1073741824" returned: 0 in 0.587s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:53 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af Aug 01 15:03:53 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:53 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af" returned: 0 in 0.312s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:03:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad7608d-ff77-41a8-bb3d-84b617ccd52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826eef75-e6d5-4bff-bdaa-2386f7e981af', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549b978b-0e1f-4c5a-84a1-b1588693504f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:53 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Volume volume-826eef75-e6d5-4bff-bdaa-2386f7e981af (826eef75-e6d5-4bff-bdaa-2386f7e981af): created successfully Aug 01 15:03:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549b978b-0e1f-4c5a-84a1-b1588693504f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Flow 'volume_create_manager' (8c0e1cb7-33df-4342-95b8-f4ac65445283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-76605817-dada-49d7-aa76-1ce115f04239 tempest-VolumesTransfersTest-442941509 None] Created volume successfully. Aug 01 15:03:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7d606468-f5e0-424e-81c9-57f69504256b tempest-VolumesTransfersTest-1884113886 None] Transfer volume completed successfully. Aug 01 15:03:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Acquiring lock "cinder-826eef75-e6d5-4bff-bdaa-2386f7e981af-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Lock "cinder-826eef75-e6d5-4bff-bdaa-2386f7e981af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Acquiring lock "cinder-quobyte-826eef75-e6d5-4bff-bdaa-2386f7e981af" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:03:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Lock "cinder-quobyte-826eef75-e6d5-4bff-bdaa-2386f7e981af" acquired by "delete_volume" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:03:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2985cb9-d74c-4be1-b4d2-8a7c88edaf93]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:03:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:56 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af Aug 01 15:03:56 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:56 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af" returned: 0 in 0.458s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:56 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af Aug 01 15:03:56 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:57 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-826eef75-e6d5-4bff-bdaa-2386f7e981af" returned: 0 in 0.291s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Lock "cinder-quobyte-826eef75-e6d5-4bff-bdaa-2386f7e981af" released by "delete_volume" :: held 0.819s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Created reservations ['6645c700-7043-43fa-ae85-8d58e12f35d2', '9902ab1a-ed88-46b3-b6c1-c2b3608cdafb', 'd65bf3e8-9721-4e7c-b98a-e2524848dd51', '34dbef58-b8ce-47ca-8c12-84810e79d082'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:57 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:03:57 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:57 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.270s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:03:57 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Deleted volume successfully. Aug 01 15:03:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b24eb9d5-1872-4711-9a2b-260103d71a06 tempest-VolumesTransfersTest-1719166171 None] Lock "cinder-826eef75-e6d5-4bff-bdaa-2386f7e981af-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Flow 'volume_create_manager' (9a9f4fbb-0bb9-41fa-9d95-929aaa6eb1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdb3559-cb04-4035-8967-eaf104bc64c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdb3559-cb04-4035-8967-eaf104bc64c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1944872313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768b701c-0e1b-4f77-87f3-5cce6899190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c08d1e26834afd9fff9bdde2a8925b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:58Z,use_quota=True,user_id='5b1e2693e18a4062b80bc66088f293e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2aefde-5181-43e2-90b0-93931e96e564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2aefde-5181-43e2-90b0-93931e96e564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526d6fdc-2aa7-487f-a2d4-0a459fda75da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526d6fdc-2aa7-487f-a2d4-0a459fda75da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '768b701c-0e1b-4f77-87f3-5cce6899190b', 'volume_name': 'volume-768b701c-0e1b-4f77-87f3-5cce6899190b', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b331259-29d0-4c30-9535-6a6c892198fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b331259-29d0-4c30-9535-6a6c892198fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ae1448-4087-48e1-aaa4-3752f3a9e105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:58 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Volume 768b701c-0e1b-4f77-87f3-5cce6899190b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-768b701c-0e1b-4f77-87f3-5cce6899190b', 'volume_size': 1} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1944872313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768b701c-0e1b-4f77-87f3-5cce6899190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c08d1e26834afd9fff9bdde2a8925b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:03:58Z,use_quota=True,user_id='5b1e2693e18a4062b80bc66088f293e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Creating volume 768b701c-0e1b-4f77-87f3-5cce6899190b {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:03:58 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:03:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:58 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b 1073741824 Aug 01 15:03:58 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b 1073741824" returned: 0 in 0.861s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:59 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:59 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=77,cinder:UPDATE=90,cinder:INSERT=24,cinder:DELETE=9 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:03:59 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=69,cinder:UPDATE=94,cinder:DELETE=7,cinder:INSERT=16 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:03:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:03:59 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b Aug 01 15:03:59 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:03:59 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Aug 01 15:03:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b" returned: 0 in 0.346s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:03:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:03:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:03:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ae1448-4087-48e1-aaa4-3752f3a9e105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768b701c-0e1b-4f77-87f3-5cce6899190b', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900cbf22-b75b-4017-b6e6-6a05c8da218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:03:59 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Volume volume-768b701c-0e1b-4f77-87f3-5cce6899190b (768b701c-0e1b-4f77-87f3-5cce6899190b): created successfully Aug 01 15:03:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900cbf22-b75b-4017-b6e6-6a05c8da218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:03:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Flow 'volume_create_manager' (9a9f4fbb-0bb9-41fa-9d95-929aaa6eb1a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:03:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fe7aec44-4b7e-42dd-a4d8-1c06a1f14613 tempest-VolumesTransfersTest-442941509 None] Created volume successfully. Aug 01 15:04:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Acquiring lock "cinder-768b701c-0e1b-4f77-87f3-5cce6899190b-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Lock "cinder-768b701c-0e1b-4f77-87f3-5cce6899190b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Acquiring lock "cinder-quobyte-768b701c-0e1b-4f77-87f3-5cce6899190b" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Lock "cinder-quobyte-768b701c-0e1b-4f77-87f3-5cce6899190b" acquired by "delete_volume" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:01 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[312d712b-c539-47dc-b4fd-bcb3a957d421]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:01 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b Aug 01 15:04:01 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:01 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b" returned: 0 in 0.481s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:01 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b Aug 01 15:04:01 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:01 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-768b701c-0e1b-4f77-87f3-5cce6899190b" returned: 0 in 0.329s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Lock "cinder-quobyte-768b701c-0e1b-4f77-87f3-5cce6899190b" released by "delete_volume" :: held 0.873s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:02 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Created reservations ['0154d020-f0fb-4d5b-a44c-7f7848fd70c6', '4aabed20-7c05-4e01-8509-d0104ab620cf', '16fa7617-6788-4f92-a44a-e5a646d0ebae', 'b1c899f1-895e-4e3f-81e8-756295a3b682'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:04:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:02 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:04:02 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:02 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.308s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:02 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:04:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Deleted volume successfully. Aug 01 15:04:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c64a38-79b6-4970-9853-ca6e9a00bb4c tempest-VolumesTransfersTest-1719166171 None] Lock "cinder-768b701c-0e1b-4f77-87f3-5cce6899190b-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-ec60bfee-7a99-4c3e-9565-2d6e221135dc req-faf4f453-1e40-4421-b26b-9ec3186b5107 tempest-ServerActionsTestOtherA-225605167 None] Terminate volume connection completed successfully. Aug 01 15:04:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-ec60bfee-7a99-4c3e-9565-2d6e221135dc req-faf4f453-1e40-4421-b26b-9ec3186b5107 tempest-ServerActionsTestOtherA-225605167 None] Deleting attachment c4c5da17-8e1d-4596-939a-9c69d5c48ca6. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Flow 'volume_create_manager' (8637b175-180d-4375-9b43-60610ed18666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c85bc0-ad99-4b19-8694-8b19280f9fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c85bc0-ad99-4b19-8694-8b19280f9fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1297227870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba467fbd-686d-441f-ae2f-8c8c53e98542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25432525e3c422a8bbe9a69c7c87d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:13Z,use_quota=True,user_id='119618d294ba44b6a152b6a26ee59b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27c93ee-f8cc-4ee5-9c62-28df2d84b19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27c93ee-f8cc-4ee5-9c62-28df2d84b19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafba076-848e-42ca-9ec1-99fffdce6599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafba076-848e-42ca-9ec1-99fffdce6599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba467fbd-686d-441f-ae2f-8c8c53e98542', 'volume_name': 'volume-ba467fbd-686d-441f-ae2f-8c8c53e98542', 'volume_size': 2}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8ea298-2e32-4851-8527-089f868c4313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8ea298-2e32-4851-8527-089f868c4313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b02e615-f440-41e0-9d86-07554f15d2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:13 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Volume ba467fbd-686d-441f-ae2f-8c8c53e98542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba467fbd-686d-441f-ae2f-8c8c53e98542', 'volume_size': 2} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1297227870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba467fbd-686d-441f-ae2f-8c8c53e98542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c25432525e3c422a8bbe9a69c7c87d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:13Z,use_quota=True,user_id='119618d294ba44b6a152b6a26ee59b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Creating volume ba467fbd-686d-441f-ae2f-8c8c53e98542 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:04:13 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:04:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542 2147483648 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:13 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542 2147483648 Aug 01 15:04:13 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:14 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=8,cinder:DELETE=2,cinder:SELECT=7,cinder:INSERT=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:04:14 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542 2147483648" returned: 0 in 0.989s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:14 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542 Aug 01 15:04:14 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Flow 'volume_create_manager' (5b5450a9-2f08-42a9-9e0e-3aadf5f5aa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0992bec3-5a3e-48c7-ad78-681d10571246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0992bec3-5a3e-48c7-ad78-681d10571246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1639057527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58426b0f-c034-467e-8f0a-7e090a44d6c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb192cfd7a1d48898747da3593dd0c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:15Z,use_quota=True,user_id='7f318794dfdd4e089ab88f7ca83f11d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24136fb4-13e5-4240-833b-ca8c3584fe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24136fb4-13e5-4240-833b-ca8c3584fe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd4666c-de05-4886-a6fd-da95d8cd1fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:04:15 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542" returned: 0 in 0.383s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b02e615-f440-41e0-9d86-07554f15d2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba467fbd-686d-441f-ae2f-8c8c53e98542', 'volume_size': 2}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303ca732-d98b-4cfe-9ab1-d4891192706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:15 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Volume volume-ba467fbd-686d-441f-ae2f-8c8c53e98542 (ba467fbd-686d-441f-ae2f-8c8c53e98542): created successfully Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303ca732-d98b-4cfe-9ab1-d4891192706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Flow 'volume_create_manager' (8637b175-180d-4375-9b43-60610ed18666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3a00971f-7c13-4066-8243-4aa78f992f65 tempest-VolumesCloneNegativeTest-2065503180 None] Created volume successfully. Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd4666c-de05-4886-a6fd-da95d8cd1fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '58426b0f-c034-467e-8f0a-7e090a44d6c0', 'volume_name': 'volume-58426b0f-c034-467e-8f0a-7e090a44d6c0', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1736e2c6-9ad1-4b6a-ad86-402ae62f6a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1736e2c6-9ad1-4b6a-ad86-402ae62f6a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42452e67-6356-4a00-8269-3924f381f285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:15 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Volume 58426b0f-c034-467e-8f0a-7e090a44d6c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-58426b0f-c034-467e-8f0a-7e090a44d6c0', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Trying to clone 58426b0f-c034-467e-8f0a-7e090a44d6c0 from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Acquiring lock "cinder-ba467fbd-686d-441f-ae2f-8c8c53e98542-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Lock "cinder-ba467fbd-686d-441f-ae2f-8c8c53e98542-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Acquiring lock "cinder-quobyte-ba467fbd-686d-441f-ae2f-8c8c53e98542" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Lock "cinder-quobyte-ba467fbd-686d-441f-ae2f-8c8c53e98542" acquired by "delete_volume" :: waited 0.037s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:16 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2697725d-da2c-454a-83a6-fe18a59c84a9]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:16 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542 Aug 01 15:04:16 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:16 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:04:16 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Image download 20.69 MB at 20.69 MB/s Aug 01 15:04:16 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4912c8f9-a06b-4b1a-9ab4-bffdefcfbb4f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:16 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD Aug 01 15:04:16 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:16 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542" returned: 0 in 0.673s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:16 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542 Aug 01 15:04:16 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:17 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD" returned: 0 in 0.448s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf is fetched for user 7f318794dfdd4e089ab88f7ca83f11d0. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6ec093-9255-406b-8058-da8bf4abf060]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:17 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD Aug 01 15:04:17 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:17 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ba467fbd-686d-441f-ae2f-8c8c53e98542" returned: 0 in 0.531s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Lock "cinder-quobyte-ba467fbd-686d-441f-ae2f-8c8c53e98542" released by "delete_volume" :: held 1.328s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Created reservations ['2c4a0490-5137-4630-b119-a2789eeb0343', 'c0f5778c-bfbf-4123-bf00-a909962ecd04', '6f99e5d2-c28c-4272-bde7-4710de8fd519', '732ac04a-9dc0-4a6e-a1b1-3e19d9884f52'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:17 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:04:17 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:17 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1639057527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58426b0f-c034-467e-8f0a-7e090a44d6c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb192cfd7a1d48898747da3593dd0c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:15Z,use_quota=True,user_id='7f318794dfdd4e089ab88f7ca83f11d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Creating volume 58426b0f-c034-467e-8f0a-7e090a44d6c0 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:04:17 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:04:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:17 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 1073741824 Aug 01 15:04:17 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:17 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.384s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:04:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Deleted volume successfully. Aug 01 15:04:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f8a6426d-2617-4306-899d-03be1bcaa978 tempest-VolumesCloneNegativeTest-2065503180 None] Lock "cinder-ba467fbd-686d-441f-ae2f-8c8c53e98542-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:04:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:18 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:04:18 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:19 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 1073741824" returned: 0 in 1.250s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:19 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 Aug 01 15:04:19 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:19 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.851s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:04:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:04:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:04:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:04:20 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0" returned: 0 in 0.752s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:04:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:20 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Attempting download of a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 58426b0f-c034-467e-8f0a-7e090a44d6c0. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:04:20 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bbf5c4-0c5a-4aed-b41f-f05e40baecef]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_we7ebkno {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:20 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_we7ebkno Aug 01 15:04:20 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:20 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_we7ebkno" returned: 0 in 0.530s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_we7ebkno {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:20 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_we7ebkno Aug 01 15:04:20 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:21 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_we7ebkno" returned: 1 in 0.551s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_we7ebkno' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:04:21 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c711daec-7795-4389-9475-7ee90732cc46]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:21 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD Aug 01 15:04:21 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:21 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:21 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf was qcow2, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:04:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:21 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 Aug 01 15:04:21 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:24 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0" returned: 0 in 2.778s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:24 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ocnvam3mdevstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:04:24 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Converted 112.00 MB image at 40.28 MB/s Aug 01 15:04:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:24 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 1G Aug 01 15:04:24 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:25 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 1G" returned: 0 in 0.786s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Downloaded image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 58426b0f-c034-467e-8f0a-7e090a44d6c0 successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf for user 7f318794dfdd4e089ab88f7ca83f11d0 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Marking volume 58426b0f-c034-467e-8f0a-7e090a44d6c0 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Copying metadata from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf to 58426b0f-c034-467e-8f0a-7e090a44d6c0. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Creating volume glance metadata for volume 58426b0f-c034-467e-8f0a-7e090a44d6c0 backed by image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (9926a62f-5120-4add-a542-ea0216b4cffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2e7e18-8b6f-4fdd-bc80-0fbc4e7de07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2e7e18-8b6f-4fdd-bc80-0fbc4e7de07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-755742909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28404df2-e7a1-4ad9-bd48-9bd00c0bf857,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:25Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea7b02d-7d5b-4bb2-b2bc-922b4946329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea7b02d-7d5b-4bb2-b2bc-922b4946329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f1f266-3fe2-445e-ab8e-1e2bed59612f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f1f266-3fe2-445e-ab8e-1e2bed59612f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28404df2-e7a1-4ad9-bd48-9bd00c0bf857', 'volume_name': 'volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b5bfee-af39-480a-a52f-628a559b40d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b5bfee-af39-480a-a52f-628a559b40d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b006fd-06e8-4d58-9fe7-70f14ee413eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:25 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Volume 28404df2-e7a1-4ad9-bd48-9bd00c0bf857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857', 'volume_size': 1} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-755742909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28404df2-e7a1-4ad9-bd48-9bd00c0bf857,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:25Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Creating volume 28404df2-e7a1-4ad9-bd48-9bd00c0bf857 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:04:25 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:25 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857 1073741824 Aug 01 15:04:25 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42452e67-6356-4a00-8269-3924f381f285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58426b0f-c034-467e-8f0a-7e090a44d6c0', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828ac682-af75-4cb4-aadf-c6fc565a2da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:25 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Volume volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 (58426b0f-c034-467e-8f0a-7e090a44d6c0): created successfully Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828ac682-af75-4cb4-aadf-c6fc565a2da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Flow 'volume_create_manager' (5b5450a9-2f08-42a9-9e0e-3aadf5f5aa2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:25 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3f2080fd-e1a5-4cea-8cfa-d0b0ae60003c tempest-ServerActionsTestOtherA-225605167 None] Created volume successfully. Aug 01 15:04:26 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857 1073741824" returned: 0 in 0.857s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:26 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857 Aug 01 15:04:26 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:26 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857" returned: 0 in 0.384s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:04:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b006fd-06e8-4d58-9fe7-70f14ee413eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d9cc3c-7481-406b-9190-3a1ce7749041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:26 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Volume volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857 (28404df2-e7a1-4ad9-bd48-9bd00c0bf857): created successfully Aug 01 15:04:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d9cc3c-7481-406b-9190-3a1ce7749041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (9926a62f-5120-4add-a542-ea0216b4cffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7b0f8d25-8c7d-4e2b-ba79-fae586e2a6d9 tempest-VolumesGetTest-2114708775 None] Created volume successfully. Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (1913e959-7dce-4fba-86cc-21eddc15e30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1083a6dd-78dd-48b1-92db-1967d83eed1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1083a6dd-78dd-48b1-92db-1967d83eed1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1258835409',display_name='tempest-VolumesGetTest-Volume-1048721365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d724792-9b34-4a2a-b480-b8071ed4445c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:29Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e956bef-649c-4812-bcc7-741e7abfc2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e956bef-649c-4812-bcc7-741e7abfc2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fe1eb8-444f-4ab0-bd62-1376899ebe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fe1eb8-444f-4ab0-bd62-1376899ebe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d724792-9b34-4a2a-b480-b8071ed4445c', 'volume_name': 'volume-8d724792-9b34-4a2a-b480-b8071ed4445c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed87e9fd-5756-4575-846a-b2c5cadf6e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed87e9fd-5756-4575-846a-b2c5cadf6e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edd2a48-196b-49fe-88d2-206ce0fb68a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:28 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Volume 8d724792-9b34-4a2a-b480-b8071ed4445c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d724792-9b34-4a2a-b480-b8071ed4445c', 'volume_size': 1} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1258835409',display_name='tempest-VolumesGetTest-Volume-1048721365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d724792-9b34-4a2a-b480-b8071ed4445c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:29Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Creating volume 8d724792-9b34-4a2a-b480-b8071ed4445c {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:04:28 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:04:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:28 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c 1073741824 Aug 01 15:04:28 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:29 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c 1073741824" returned: 0 in 0.576s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:29 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c Aug 01 15:04:29 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:29 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c" returned: 0 in 0.353s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:04:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edd2a48-196b-49fe-88d2-206ce0fb68a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d724792-9b34-4a2a-b480-b8071ed4445c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64322440-a0b7-4f59-9eec-55b744293bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:29 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Volume volume-8d724792-9b34-4a2a-b480-b8071ed4445c (8d724792-9b34-4a2a-b480-b8071ed4445c): created successfully Aug 01 15:04:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64322440-a0b7-4f59-9eec-55b744293bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (1913e959-7dce-4fba-86cc-21eddc15e30a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:30 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6c8f21dc-5e2f-4f99-8000-bc11c5fe9abc tempest-VolumesGetTest-2114708775 None] Created volume successfully. Aug 01 15:04:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c449767b-f771-4603-bfd8-5369af5c3766 req-a3484a22-aa1a-4b91-992f-b36bf9498187 tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c449767b-f771-4603-bfd8-5369af5c3766 req-a3484a22-aa1a-4b91-992f-b36bf9498187 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c449767b-f771-4603-bfd8-5369af5c3766 req-a3484a22-aa1a-4b91-992f-b36bf9498187 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c449767b-f771-4603-bfd8-5369af5c3766 req-a3484a22-aa1a-4b91-992f-b36bf9498187 tempest-ServerActionsTestOtherA-225605167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-58426b0f-c034-467e-8f0a-7e090a44d6c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8bcc21c-a0b4-4ce6-b364-9ab5a44c2a15', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:04:30 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-c449767b-f771-4603-bfd8-5369af5c3766 req-a3484a22-aa1a-4b91-992f-b36bf9498187 tempest-ServerActionsTestOtherA-225605167 None] attachment_update completed successfully. Aug 01 15:04:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-8d724792-9b34-4a2a-b480-b8071ed4445c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Lock "cinder-8d724792-9b34-4a2a-b480-b8071ed4445c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-quobyte-8d724792-9b34-4a2a-b480-b8071ed4445c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-8d724792-9b34-4a2a-b480-b8071ed4445c" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:31 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3205c53d-6a48-4a7b-9d9a-0fd80fbbe3eb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:31 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c Aug 01 15:04:31 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:31 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c" returned: 0 in 0.450s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:31 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c Aug 01 15:04:31 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:32 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8d724792-9b34-4a2a-b480-b8071ed4445c" returned: 0 in 0.346s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-8d724792-9b34-4a2a-b480-b8071ed4445c" released by "delete_volume" :: held 0.856s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Created reservations ['99cf62f6-4f31-4051-bc72-c54550553af2', '00d09f5b-a7e4-4fef-96fd-3e0971bf2354', '2afe6123-ae05-4e1e-8d14-57f90db5056a', 'cac4a9a4-4aea-42f3-a811-3054c5e41c9b'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:32 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:04:32 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-28404df2-e7a1-4ad9-bd48-9bd00c0bf857-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Lock "cinder-28404df2-e7a1-4ad9-bd48-9bd00c0bf857-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-quobyte-28404df2-e7a1-4ad9-bd48-9bd00c0bf857" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-28404df2-e7a1-4ad9-bd48-9bd00c0bf857" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1773665-7ea1-4053-bacf-9e38a9010970]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:32 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.393s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:04:32 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Deleted volume successfully. Aug 01 15:04:32 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857 Aug 01 15:04:32 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6eab673-0cc0-4504-9c77-f9c7cb1d7c0f tempest-VolumesGetTest-2114708775 None] Lock "cinder-8d724792-9b34-4a2a-b480-b8071ed4445c-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:33 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857" returned: 0 in 0.478s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:33 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857 Aug 01 15:04:33 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:33 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-28404df2-e7a1-4ad9-bd48-9bd00c0bf857" returned: 0 in 0.383s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-28404df2-e7a1-4ad9-bd48-9bd00c0bf857" released by "delete_volume" :: held 0.995s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:33 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Created reservations ['a1ad84b8-89d1-4bf4-b200-dc38525a23ea', 'a8f2876a-0486-4369-a1b4-78ba59a55f3d', 'ae9f5362-a09a-46f8-a3cd-17b9f54fc3dd', '3659446f-483c-48b5-a5a4-ff8a3b77c624'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:04:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:33 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:04:33 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:34 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.401s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:34 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:04:34 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Deleted volume successfully. Aug 01 15:04:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a5ad0047-0bc2-4a43-b5c3-04d3ce70ac88 tempest-VolumesGetTest-2114708775 None] Lock "cinder-28404df2-e7a1-4ad9-bd48-9bd00c0bf857-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (c2aab630-484a-482c-a16b-dfad52ee28e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a845ac2f-0d49-4d09-9417-4b565342a3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a845ac2f-0d49-4d09-9417-4b565342a3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-198733164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1905d4-95f2-49da-834b-78cbf539fcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:35Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13422bfc-d883-4167-aa5e-8a186cf01554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13422bfc-d883-4167-aa5e-8a186cf01554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3801e44-28a8-4594-9839-08263a96b11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3801e44-28a8-4594-9839-08263a96b11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1905d4-95f2-49da-834b-78cbf539fcb2', 'volume_name': 'volume-bd1905d4-95f2-49da-834b-78cbf539fcb2', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9d7d09-1eff-4e28-b247-4fb4fe089606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9d7d09-1eff-4e28-b247-4fb4fe089606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c882d488-ea40-4b91-bc47-28b41de915d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:35 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Volume bd1905d4-95f2-49da-834b-78cbf539fcb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1905d4-95f2-49da-834b-78cbf539fcb2', 'volume_size': 1} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-198733164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1905d4-95f2-49da-834b-78cbf539fcb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:35Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Creating volume bd1905d4-95f2-49da-834b-78cbf539fcb2 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:04:35 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:04:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:35 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 1073741824 Aug 01 15:04:35 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:36 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 1073741824" returned: 0 in 0.607s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:36 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 Aug 01 15:04:36 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:36 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2" returned: 0 in 0.340s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:04:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c882d488-ea40-4b91-bc47-28b41de915d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1905d4-95f2-49da-834b-78cbf539fcb2', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1bffa9-7357-4084-bbbe-77cefcadb53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:36 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Volume volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 (bd1905d4-95f2-49da-834b-78cbf539fcb2): created successfully Aug 01 15:04:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1bffa9-7357-4084-bbbe-77cefcadb53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (c2aab630-484a-482c-a16b-dfad52ee28e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:36 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3b969e32-2f44-4351-8a1f-c676770d8a1e tempest-VolumesGetTest-2114708775 None] Created volume successfully. Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (cdc828b2-6aae-402e-9da6-cedfc57a8361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410f734a-ef5c-4ff5-b3ec-77d06947f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410f734a-ef5c-4ff5-b3ec-77d06947f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1327882320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d309e515-4bd0-4098-90a8-2d25e8bf92e5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=bd1905d4-95f2-49da-834b-78cbf539fcb2,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:38Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c43da5-895e-49df-8724-345e62a533b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c43da5-895e-49df-8724-345e62a533b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4518f7-94d7-4fb8-935f-a3116f7e736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4518f7-94d7-4fb8-935f-a3116f7e736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd309e515-4bd0-4098-90a8-2d25e8bf92e5', 'volume_name': 'volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5', 'volume_size': 1, 'source_volid': 'bd1905d4-95f2-49da-834b-78cbf539fcb2', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb1f964-fb7d-49c2-90ed-fe5ecb0d47d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb1f964-fb7d-49c2-90ed-fe5ecb0d47d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd34db65-597d-428b-b9a3-6fc45d73b425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:38 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Volume d309e515-4bd0-4098-90a8-2d25e8bf92e5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5', 'volume_size': 1, 'source_volid': 'bd1905d4-95f2-49da-834b-78cbf539fcb2', 'source_volstatus': 'available'} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:38 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Cloning volume bd1905d4-95f2-49da-834b-78cbf539fcb2 to volume d309e515-4bd0-4098-90a8-2d25e8bf92e5 Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Creating offline snapshot 872647f1-4214-45ae-960d-19a4b5e39089 of volume bd1905d4-95f2-49da-834b-78cbf539fcb2 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66e7809-fe4d-464e-b62b-461839ed610c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:38 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 Aug 01 15:04:38 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:38 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2" returned: 0 in 0.462s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:38 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 1G Aug 01 15:04:38 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:39 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 1G" returned: 0 in 0.595s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:39 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 Aug 01 15:04:39 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:39 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089" returned: 0 in 0.440s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:39 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 is being set with open permissions: ugo+rw Aug 01 15:04:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:39 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 Aug 01 15:04:39 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:40 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089" returned: 0 in 0.474s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:40 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.info Aug 01 15:04:40 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Flow 'volume_create_manager' (ec894e21-ec18-41f8-b25c-8ef53bd669ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34611e69-3b5b-4582-b646-9471aaeddc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34611e69-3b5b-4582-b646-9471aaeddc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-74125254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0251a4-4d71-4c36-98e7-c02170c890f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999966be2fc34354b1add21372b973a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:41Z,use_quota=True,user_id='aa46190dcf764f95843b449e1a5db8c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d14974-560a-4727-a55f-f08a7578f34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d14974-560a-4727-a55f-f08a7578f34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de99e542-6e4b-4f41-ba0b-3f83ff8c7228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de99e542-6e4b-4f41-ba0b-3f83ff8c7228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd0251a4-4d71-4c36-98e7-c02170c890f5', 'volume_name': 'volume-cd0251a4-4d71-4c36-98e7-c02170c890f5', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29053084-c88a-4787-a3bc-ee452d33a087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29053084-c88a-4787-a3bc-ee452d33a087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db78985-5a03-46a2-aaaa-c05873845d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:40 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Volume cd0251a4-4d71-4c36-98e7-c02170c890f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd0251a4-4d71-4c36-98e7-c02170c890f5', 'volume_size': 1} Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:40 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.info" returned: 0 in 0.434s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:40 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.info is being set with open permissions: ugo+rw Aug 01 15:04:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:40 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.info Aug 01 15:04:40 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:41 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.info" returned: 0 in 0.315s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-quobyte-d309e515-4bd0-4098-90a8-2d25e8bf92e5" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-d309e515-4bd0-4098-90a8-2d25e8bf92e5" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] snapshot: 872647f1-4214-45ae-960d-19a4b5e39089, volume: d309e515-4bd0-4098-90a8-2d25e8bf92e5, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[01078766-c3be-4334-b9bb-a6f6ab7711e1]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:41 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 Aug 01 15:04:41 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:41 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089" returned: 0 in 0.620s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1905d4-95f2-49da-834b-78cbf539fcb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3270c3-5757-418f-b9e8-7b57a9e08bff]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:42 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 Aug 01 15:04:42 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:42 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2" returned: 0 in 0.529s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:04:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:04:42 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:04:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:42 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 Aug 01 15:04:42 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-098abb63-5b63-40a7-a35c-0351b6d3f75a req-7d15fcf7-50b5-485d-84d8-19f55d9dbc61 tempest-ServerActionsTestOtherA-225605167 None] Terminate volume connection completed successfully. Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-098abb63-5b63-40a7-a35c-0351b6d3f75a req-7d15fcf7-50b5-485d-84d8-19f55d9dbc61 tempest-ServerActionsTestOtherA-225605167 None] Deleting attachment e8bcc21c-a0b4-4ce6-b364-9ab5a44c2a15. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Flow 'volume_create_manager' (4d8fcad0-8857-4e5f-a720-9ecc38e3e95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84df9be6-d8f4-4c1f-be2e-8a8b29da0b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84df9be6-d8f4-4c1f-be2e-8a8b29da0b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-401094275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e619132a-644d-43a7-830e-8b131be80ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab0a335f1f6483882f88e9aa3dac669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:48Z,use_quota=True,user_id='8b1fe064013341feaa36b9fadabff059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25cee9e-88dd-4094-9fdf-a2fabf0dbd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25cee9e-88dd-4094-9fdf-a2fabf0dbd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c68c21-43b8-4c50-8a49-1c346d80147f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c68c21-43b8-4c50-8a49-1c346d80147f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e619132a-644d-43a7-830e-8b131be80ae0', 'volume_name': 'volume-e619132a-644d-43a7-830e-8b131be80ae0', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932ec3f3-3ceb-4d73-8ff4-b24f2d9afdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932ec3f3-3ceb-4d73-8ff4-b24f2d9afdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93448e05-96e2-4b18-ab50-dd7f8d5a9c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:48 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Volume e619132a-644d-43a7-830e-8b131be80ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e619132a-644d-43a7-830e-8b131be80ae0', 'volume_size': 1} Aug 01 15:04:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:49 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5" returned: 0 in 7.331s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:49 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2, size 1024.00 MB, duration 7.33 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:04:49 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Converted 1024.00 MB image at 139.66 MB/s Aug 01 15:04:49 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 is being set with open permissions: ugo+rw Aug 01 15:04:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:49 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 Aug 01 15:04:49 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:50 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5" returned: 0 in 0.325s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-d309e515-4bd0-4098-90a8-2d25e8bf92e5" released by "_copy_volume_from_snapshot" :: held 8.939s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-quobyte-872647f1-4214-45ae-960d-19a4b5e39089" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-872647f1-4214-45ae-960d-19a4b5e39089" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Deleting offline snapshot 872647f1-4214-45ae-960d-19a4b5e39089 of volume bd1905d4-95f2-49da-834b-78cbf539fcb2 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] snapshot_file for this snap is: volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f5c98-e30f-4c7d-8a6c-187de17e8716]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:50 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 Aug 01 15:04:50 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:50 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089" returned: 0 in 0.364s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1905d4-95f2-49da-834b-78cbf539fcb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18fc33e-a3ea-4d32-ba88-7c01d72f22ad]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:50 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 Aug 01 15:04:50 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-098abb63-5b63-40a7-a35c-0351b6d3f75a req-c61f774d-1f64-4c43-a139-569e384194b6 tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:51 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2" returned: 0 in 0.536s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:51 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 Aug 01 15:04:51 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:51 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089" returned: 0 in 0.321s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:51 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089 Aug 01 15:04:51 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:51 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2.872647f1-4214-45ae-960d-19a4b5e39089" returned: 0 in 0.244s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-872647f1-4214-45ae-960d-19a4b5e39089" released by "_delete_snapshot" :: held 1.571s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.482s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.065s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-74125254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd0251a4-4d71-4c36-98e7-c02170c890f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999966be2fc34354b1add21372b973a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:41Z,use_quota=True,user_id='aa46190dcf764f95843b449e1a5db8c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Creating volume cd0251a4-4d71-4c36-98e7-c02170c890f5 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:04:51 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:51 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5 1073741824 Aug 01 15:04:51 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd34db65-597d-428b-b9a3-6fc45d73b425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5', 'volume_size': 1, 'source_volid': 'bd1905d4-95f2-49da-834b-78cbf539fcb2', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc57ba5-7709-41dc-9b19-22593aa82e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:51 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Volume volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 (d309e515-4bd0-4098-90a8-2d25e8bf92e5): created successfully Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc57ba5-7709-41dc-9b19-22593aa82e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (cdc828b2-6aae-402e-9da6-cedfc57a8361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0fd70e9e-da20-47af-957c-52bf24ecb8c3 tempest-VolumesGetTest-2114708775 None] Created volume successfully. Aug 01 15:04:52 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5 1073741824" returned: 0 in 0.427s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:52 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5 Aug 01 15:04:52 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:52 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5" returned: 0 in 0.241s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-401094275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e619132a-644d-43a7-830e-8b131be80ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab0a335f1f6483882f88e9aa3dac669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:48Z,use_quota=True,user_id='8b1fe064013341feaa36b9fadabff059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Creating volume e619132a-644d-43a7-830e-8b131be80ae0 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:04:52 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:52 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0 1073741824 Aug 01 15:04:52 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db78985-5a03-46a2-aaaa-c05873845d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd0251a4-4d71-4c36-98e7-c02170c890f5', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febeefa0-6360-4b27-beb5-ce9106da9a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Volume volume-cd0251a4-4d71-4c36-98e7-c02170c890f5 (cd0251a4-4d71-4c36-98e7-c02170c890f5): created successfully Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (febeefa0-6360-4b27-beb5-ce9106da9a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Flow 'volume_create_manager' (ec894e21-ec18-41f8-b25c-8ef53bd669ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3e5be212-109c-40a0-982b-2170e282b3f0 tempest-AttachVolumeTestJSON-1116048949 None] Created volume successfully. Aug 01 15:04:52 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0 1073741824" returned: 0 in 0.402s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:53 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0 Aug 01 15:04:53 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:53 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0" returned: 0 in 0.290s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:04:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-098abb63-5b63-40a7-a35c-0351b6d3f75a req-c61f774d-1f64-4c43-a139-569e384194b6 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.242s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93448e05-96e2-4b18-ab50-dd7f8d5a9c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e619132a-644d-43a7-830e-8b131be80ae0', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ebb121-6f5e-4ec0-9ef9-3414cf2521bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-098abb63-5b63-40a7-a35c-0351b6d3f75a req-c61f774d-1f64-4c43-a139-569e384194b6 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:53 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Volume volume-e619132a-644d-43a7-830e-8b131be80ae0 (e619132a-644d-43a7-830e-8b131be80ae0): created successfully Aug 01 15:04:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ebb121-6f5e-4ec0-9ef9-3414cf2521bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Flow 'volume_create_manager' (4d8fcad0-8857-4e5f-a720-9ecc38e3e95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1be08650-22d9-4b3b-8e80-7e767adf8573 tempest-AttachVolumeShelveTestJSON-1849564344 None] Created volume successfully. Aug 01 15:04:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-098abb63-5b63-40a7-a35c-0351b6d3f75a req-c61f774d-1f64-4c43-a139-569e384194b6 tempest-ServerActionsTestOtherA-225605167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-58426b0f-c034-467e-8f0a-7e090a44d6c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13967493-5186-41ad-8811-a976f7b35065', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:04:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-098abb63-5b63-40a7-a35c-0351b6d3f75a req-c61f774d-1f64-4c43-a139-569e384194b6 tempest-ServerActionsTestOtherA-225605167 None] attachment_update completed successfully. Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (09c5e59f-62da-43a6-9164-3071502fa641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ea63cd-3feb-49ac-b492-843487261cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ea63cd-3feb-49ac-b492-843487261cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-952153191',display_name='tempest-VolumesGetTest-Volume-465342563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf32ef1-a61a-4aeb-9a80-84c2638d4761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:54Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d47cd2b-4c8a-4133-8264-670ad52c2fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d47cd2b-4c8a-4133-8264-670ad52c2fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccb1de1-bf4a-4581-a5f3-576440990a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccb1de1-bf4a-4581-a5f3-576440990a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaf32ef1-a61a-4aeb-9a80-84c2638d4761', 'volume_name': 'volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48ce5c4-11e6-4aa2-8b31-9dcb0ee35e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48ce5c4-11e6-4aa2-8b31-9dcb0ee35e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a8a798-241f-4fe7-9290-063c4ced9d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:54 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Volume aaf32ef1-a61a-4aeb-9a80-84c2638d4761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761', 'volume_size': 1} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-952153191',display_name='tempest-VolumesGetTest-Volume-465342563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf32ef1-a61a-4aeb-9a80-84c2638d4761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:54Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Creating volume aaf32ef1-a61a-4aeb-9a80-84c2638d4761 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:04:54 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:54 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761 1073741824 Aug 01 15:04:54 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-871bbad8-f9b0-4835-93ba-f00364adb2fd req-67c2cc7f-55e8-41a6-aa51-a7bfcfbadc62 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:55 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761 1073741824" returned: 0 in 0.858s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:55 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761 Aug 01 15:04:55 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:55 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761" returned: 0 in 0.354s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-871bbad8-f9b0-4835-93ba-f00364adb2fd req-67c2cc7f-55e8-41a6-aa51-a7bfcfbadc62 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.094s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a8a798-241f-4fe7-9290-063c4ced9d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301fed5b-8069-418f-a81c-710fd88a1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-871bbad8-f9b0-4835-93ba-f00364adb2fd req-67c2cc7f-55e8-41a6-aa51-a7bfcfbadc62 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:55 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Volume volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761 (aaf32ef1-a61a-4aeb-9a80-84c2638d4761): created successfully Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301fed5b-8069-418f-a81c-710fd88a1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (09c5e59f-62da-43a6-9164-3071502fa641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4ef5f671-1998-4e4b-a4d0-d9beed8d19ac tempest-VolumesGetTest-2114708775 None] Created volume successfully. Aug 01 15:04:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-871bbad8-f9b0-4835-93ba-f00364adb2fd req-67c2cc7f-55e8-41a6-aa51-a7bfcfbadc62 tempest-AttachVolumeTestJSON-1116048949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-cd0251a4-4d71-4c36-98e7-c02170c890f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7143736-69b2-4dba-a96c-5a7ca69d7ee2', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:04:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-871bbad8-f9b0-4835-93ba-f00364adb2fd req-67c2cc7f-55e8-41a6-aa51-a7bfcfbadc62 tempest-AttachVolumeTestJSON-1116048949 None] attachment_update completed successfully. Aug 01 15:04:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-aaf32ef1-a61a-4aeb-9a80-84c2638d4761-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Lock "cinder-aaf32ef1-a61a-4aeb-9a80-84c2638d4761-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-quobyte-aaf32ef1-a61a-4aeb-9a80-84c2638d4761" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-aaf32ef1-a61a-4aeb-9a80-84c2638d4761" acquired by "delete_volume" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[304bea71-12a8-4d55-95b4-dd6b4b9fbe00]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:56 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761 Aug 01 15:04:56 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:57 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761" returned: 0 in 0.436s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:57 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761 Aug 01 15:04:57 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:57 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-aaf32ef1-a61a-4aeb-9a80-84c2638d4761" returned: 0 in 0.421s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-aaf32ef1-a61a-4aeb-9a80-84c2638d4761" released by "delete_volume" :: held 0.943s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:57 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Created reservations ['21af2844-7291-4f93-a31f-eb3dccbbe8fb', '36e83be8-25d7-47f1-9913-d94a2b3e7192', '1c18966e-378b-4db2-bc00-e91b93c2fac5', 'c6a354fe-498b-4460-99e5-737366ed8ae6'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:58 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:04:58 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:58 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.402s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:04:58 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Deleted volume successfully. Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e93e286b-94e6-4a07-abf2-1b1ec6e130e7 tempest-VolumesGetTest-2114708775 None] Lock "cinder-aaf32ef1-a61a-4aeb-9a80-84c2638d4761-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Flow 'volume_create_manager' (45e7a06e-5269-48b6-aff0-5b5a7668b11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20419595-af48-4b0d-9e8b-ead7f4c7aba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20419595-af48-4b0d-9e8b-ead7f4c7aba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1564987820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c223f8b-87f5-463d-baff-b7d49f6dfcea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999966be2fc34354b1add21372b973a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:59Z,use_quota=True,user_id='aa46190dcf764f95843b449e1a5db8c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5101eda3-b8e6-4690-919b-675c084b61a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5101eda3-b8e6-4690-919b-675c084b61a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db26ff02-14e9-45f3-b43c-6cbe4a4afd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db26ff02-14e9-45f3-b43c-6cbe4a4afd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c223f8b-87f5-463d-baff-b7d49f6dfcea', 'volume_name': 'volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b934807e-b5c1-4e81-bead-1e0ffbbc192e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b934807e-b5c1-4e81-bead-1e0ffbbc192e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23af6e3b-53b2-40b1-b723-a8c2b711650d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:04:59 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Volume 5c223f8b-87f5-463d-baff-b7d49f6dfcea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea', 'volume_size': 1} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1564987820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c223f8b-87f5-463d-baff-b7d49f6dfcea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999966be2fc34354b1add21372b973a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:04:59Z,use_quota=True,user_id='aa46190dcf764f95843b449e1a5db8c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Creating volume 5c223f8b-87f5-463d-baff-b7d49f6dfcea {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:04:59 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:59 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea 1073741824 Aug 01 15:04:59 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-d309e515-4bd0-4098-90a8-2d25e8bf92e5-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Lock "cinder-d309e515-4bd0-4098-90a8-2d25e8bf92e5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-quobyte-d309e515-4bd0-4098-90a8-2d25e8bf92e5" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-d309e515-4bd0-4098-90a8-2d25e8bf92e5" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08cb09a-31b4-46fb-813b-2a00fd9eabfd]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:04:59 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 Aug 01 15:04:59 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:04:59 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea 1073741824" returned: 0 in 0.818s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=79,cinder:INSERT=22,cinder:UPDATE=76,cinder:DELETE=7 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:04:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:00 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea Aug 01 15:05:00 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:00 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5" returned: 0 in 0.691s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:00 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5 Aug 01 15:05:00 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:00 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea" returned: 0 in 0.528s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23af6e3b-53b2-40b1-b723-a8c2b711650d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c720d2-6f65-4b91-be3c-c3fc8f6efac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:00 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Volume volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea (5c223f8b-87f5-463d-baff-b7d49f6dfcea): created successfully Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c720d2-6f65-4b91-be3c-c3fc8f6efac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Flow 'volume_create_manager' (45e7a06e-5269-48b6-aff0-5b5a7668b11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6ea48f6c-b0d2-4f32-8be6-a54cef57549e tempest-AttachVolumeTestJSON-1116048949 None] Created volume successfully. Aug 01 15:05:00 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d309e515-4bd0-4098-90a8-2d25e8bf92e5" returned: 0 in 0.594s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-d309e515-4bd0-4098-90a8-2d25e8bf92e5" released by "delete_volume" :: held 1.389s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Created reservations ['e50a6a83-c44e-427e-ab80-16ce8886bd2e', 'f2a3b2b8-24a3-426b-a44e-c03ad4e223d9', '968a9b12-d10e-4926-90e3-ab0bc222140c', '129fea99-3eb5-4989-ba35-a60d0e1450c4'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:01 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:01 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:01 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.473s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:01 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:01 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Deleted volume successfully. Aug 01 15:05:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6f961a61-388f-47c4-bc04-e003505bf15f tempest-VolumesGetTest-2114708775 None] Lock "cinder-d309e515-4bd0-4098-90a8-2d25e8bf92e5-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-bd1905d4-95f2-49da-834b-78cbf539fcb2-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Lock "cinder-bd1905d4-95f2-49da-834b-78cbf539fcb2-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-quobyte-bd1905d4-95f2-49da-834b-78cbf539fcb2" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-bd1905d4-95f2-49da-834b-78cbf539fcb2" acquired by "delete_volume" :: waited 0.051s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:02 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee16da5-5081-47d8-9ba8-a6d9a3a63ac4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:02 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 Aug 01 15:05:02 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-dd1b9a95-497e-48c3-9a3a-61ecc0ef736c req-d67634a5-528c-46f7-ab0f-85b5601c7d13 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-dd1b9a95-497e-48c3-9a3a-61ecc0ef736c req-d67634a5-528c-46f7-ab0f-85b5601c7d13 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-dd1b9a95-497e-48c3-9a3a-61ecc0ef736c req-d67634a5-528c-46f7-ab0f-85b5601c7d13 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:02 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2" returned: 0 in 0.795s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:02 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2 Aug 01 15:05:02 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-dd1b9a95-497e-48c3-9a3a-61ecc0ef736c req-d67634a5-528c-46f7-ab0f-85b5601c7d13 tempest-AttachVolumeTestJSON-1116048949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa2f0a8c-a21d-4587-a45c-0e6b41279d04', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:05:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-dd1b9a95-497e-48c3-9a3a-61ecc0ef736c req-d67634a5-528c-46f7-ab0f-85b5601c7d13 tempest-AttachVolumeTestJSON-1116048949 None] attachment_update completed successfully. Aug 01 15:05:03 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bd1905d4-95f2-49da-834b-78cbf539fcb2" returned: 0 in 0.538s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-bd1905d4-95f2-49da-834b-78cbf539fcb2" released by "delete_volume" :: held 1.489s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:03 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Created reservations ['717379c0-b145-4e18-9a77-a478fbbff469', '7978dceb-0f5c-4bb0-ae40-94a6e3801ba8', '223d801f-574c-4cbf-81b4-f679c88f6de7', '13a50243-467d-4dbb-ba96-3d52c69d7016'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:03 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:03 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:04 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.531s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:04 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Deleted volume successfully. Aug 01 15:05:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-72c6ad4f-7631-44d5-b6dc-254dfc940b7a tempest-VolumesGetTest-2114708775 None] Lock "cinder-bd1905d4-95f2-49da-834b-78cbf539fcb2-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:05 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (4aa9b723-d292-4f62-8049-6c3831078005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f711598-34bd-4ab3-97cc-e7ca0fc24b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f711598-34bd-4ab3-97cc-e7ca0fc24b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-100153736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07abecbc-a931-49e2-a7b8-0b52c9cb5a73,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:06Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03bcec6-93e2-445f-a7c0-e8134609461d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03bcec6-93e2-445f-a7c0-e8134609461d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84957a9c-e7f0-40f5-a1e5-673a3895048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84957a9c-e7f0-40f5-a1e5-673a3895048a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07abecbc-a931-49e2-a7b8-0b52c9cb5a73', 'volume_name': 'volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07c7a69-53ea-4cdf-8408-bbc38879ce18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07c7a69-53ea-4cdf-8408-bbc38879ce18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe279e67-9118-418f-be18-fb6dd8133981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:06 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Volume 07abecbc-a931-49e2-a7b8-0b52c9cb5a73: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 01 15:05:06 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Trying to clone 07abecbc-a931-49e2-a7b8-0b52c9cb5a73 from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:05:07 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:05:07 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Image download 20.69 MB at 20.69 MB/s Aug 01 15:05:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b295f5-3475-44b9-8575-5854c0774b66]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:07 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD Aug 01 15:05:07 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:07 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:07 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf is fetched for user 5c7260653d9b4d2b90ca51508b5672ef. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:05:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-24a1c3e3-4001-42d4-8839-7256f7b8dc30 req-cce2d149-4240-4630-bbe0-b9819658d1ad tempest-AttachVolumeTestJSON-1116048949 None] Terminate volume connection completed successfully. Aug 01 15:05:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-24a1c3e3-4001-42d4-8839-7256f7b8dc30 req-cce2d149-4240-4630-bbe0-b9819658d1ad tempest-AttachVolumeTestJSON-1116048949 None] Deleting attachment b7143736-69b2-4dba-a96c-5a7ca69d7ee2. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5deeb54-dc9f-4b26-a4b9-44344635f867]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:08 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD Aug 01 15:05:08 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:08 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-100153736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07abecbc-a931-49e2-a7b8-0b52c9cb5a73,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:06Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Creating volume 07abecbc-a931-49e2-a7b8-0b52c9cb5a73 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:05:08 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:08 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 1073741824 Aug 01 15:05:08 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-55cc1938-ea3a-4f3e-9472-a8dd9ce6b9f0 req-042ad319-25e6-47fa-8557-0f1fb875e0fc tempest-AttachVolumeShelveTestJSON-1849564344 None] No connector for attachment 30de0dc4-e34d-4c93-8110-98424a4871c5; skipping storage backend terminate_connection call. {{(pid=89024) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 01 15:05:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-55cc1938-ea3a-4f3e-9472-a8dd9ce6b9f0 req-042ad319-25e6-47fa-8557-0f1fb875e0fc tempest-AttachVolumeShelveTestJSON-1849564344 None] Deleting attachment 30de0dc4-e34d-4c93-8110-98424a4871c5. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:05:09 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 1073741824" returned: 0 in 0.536s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:09 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 Aug 01 15:05:09 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:09 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73" returned: 0 in 0.464s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:05:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:09 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Attempting download of a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 07abecbc-a931-49e2-a7b8-0b52c9cb5a73. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:05:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e5a534-de37-490d-a18a-a13d9c1cfe2e]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_se6dmczw {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:09 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_se6dmczw Aug 01 15:05:09 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:10 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_se6dmczw" returned: 0 in 0.450s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_se6dmczw {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:10 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_se6dmczw Aug 01 15:05:10 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-840de23c-2fe1-472e-8065-449b60860b09 req-7963d45a-38a3-4739-928b-cd12f16ecfed tempest-AttachVolumeTestJSON-1116048949 None] Terminate volume connection completed successfully. Aug 01 15:05:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-840de23c-2fe1-472e-8065-449b60860b09 req-7963d45a-38a3-4739-928b-cd12f16ecfed tempest-AttachVolumeTestJSON-1116048949 None] Deleting attachment aa2f0a8c-a21d-4587-a45c-0e6b41279d04. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:05:10 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_se6dmczw" returned: 1 in 0.424s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_se6dmczw' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:05:10 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d998c2-31c7-43fb-bc48-2d774e4645f9]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:10 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD Aug 01 15:05:10 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:11 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:11 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf was qcow2, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:05:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:11 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 Aug 01 15:05:11 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:14 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73" returned: 0 in 2.987s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3r_1w4vddevstack@QuobyteHD, size 112.00 MB, duration 2.99 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:05:14 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Converted 112.00 MB image at 37.44 MB/s Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:14 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 1G Aug 01 15:05:14 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:14 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 1G" returned: 0 in 0.500s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Downloaded image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 07abecbc-a931-49e2-a7b8-0b52c9cb5a73 successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf for user 5c7260653d9b4d2b90ca51508b5672ef is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Marking volume 07abecbc-a931-49e2-a7b8-0b52c9cb5a73 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=98,cinder:SELECT=95,cinder:INSERT=27,cinder:DELETE=8 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Copying metadata from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf to 07abecbc-a931-49e2-a7b8-0b52c9cb5a73. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Creating volume glance metadata for volume 07abecbc-a931-49e2-a7b8-0b52c9cb5a73 backed by image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe279e67-9118-418f-be18-fb6dd8133981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53ccb63-3e63-4fc3-b734-1428a072ea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:14 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Volume volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 (07abecbc-a931-49e2-a7b8-0b52c9cb5a73): created successfully Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53ccb63-3e63-4fc3-b734-1428a072ea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (4aa9b723-d292-4f62-8049-6c3831078005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:14 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-43f8d31e-7356-4420-bc53-02c07a145f17 tempest-VolumesGetTest-2114708775 None] Created volume successfully. Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (b96ba78f-681e-43d6-9ea5-6b45ec74d12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fdde16-de3d-4412-b1ab-eeac2b86abf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27fdde16-de3d-4412-b1ab-eeac2b86abf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:05:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-118218627',display_name='tempest-VolumesGetTest-Volume-879861154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129f8399-8971-49bf-9db0-9519bb1286e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:16Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540568a2-09fd-41ec-81ef-764dcedde0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540568a2-09fd-41ec-81ef-764dcedde0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b4f69c-b173-4c99-b7d1-7f949fdca49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b4f69c-b173-4c99-b7d1-7f949fdca49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '129f8399-8971-49bf-9db0-9519bb1286e0', 'volume_name': 'volume-129f8399-8971-49bf-9db0-9519bb1286e0', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2fa75d-4bb9-4ce7-ba0d-ddffc2af4561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2fa75d-4bb9-4ce7-ba0d-ddffc2af4561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18929bec-c310-4269-8434-c1f7592988be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:16 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Volume 129f8399-8971-49bf-9db0-9519bb1286e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-129f8399-8971-49bf-9db0-9519bb1286e0', 'volume_size': 1} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:05:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-118218627',display_name='tempest-VolumesGetTest-Volume-879861154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129f8399-8971-49bf-9db0-9519bb1286e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c433b1969a4130bec45d8c3c0a4e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:16Z,use_quota=True,user_id='5c7260653d9b4d2b90ca51508b5672ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Creating volume 129f8399-8971-49bf-9db0-9519bb1286e0 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:05:16 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:05:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:16 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0 1073741824 Aug 01 15:05:16 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:17 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0 1073741824" returned: 0 in 0.559s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:17 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0 Aug 01 15:05:17 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "cinder-5c223f8b-87f5-463d-baff-b7d49f6dfcea-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:17 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0" returned: 0 in 0.310s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-5c223f8b-87f5-463d-baff-b7d49f6dfcea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18929bec-c310-4269-8434-c1f7592988be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-129f8399-8971-49bf-9db0-9519bb1286e0', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefc0e17-ba44-41b1-9647-4956e99f3fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "cinder-quobyte-5c223f8b-87f5-463d-baff-b7d49f6dfcea" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:17 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Volume volume-129f8399-8971-49bf-9db0-9519bb1286e0 (129f8399-8971-49bf-9db0-9519bb1286e0): created successfully Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefc0e17-ba44-41b1-9647-4956e99f3fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Flow 'volume_create_manager' (b96ba78f-681e-43d6-9ea5-6b45ec74d12e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:17 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-60d143bd-e07d-4765-991c-e1297c4232cb tempest-VolumesGetTest-2114708775 None] Created volume successfully. Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-quobyte-5c223f8b-87f5-463d-baff-b7d49f6dfcea" acquired by "delete_volume" :: waited 0.036s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc28dcb4-efd2-4ddc-9b8f-e3c3251dfd8b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:17 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea Aug 01 15:05:17 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:18 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea" returned: 0 in 0.377s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:18 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea Aug 01 15:05:18 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:18 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5c223f8b-87f5-463d-baff-b7d49f6dfcea" returned: 0 in 0.263s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-quobyte-5c223f8b-87f5-463d-baff-b7d49f6dfcea" released by "delete_volume" :: held 0.687s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Created reservations ['644cc4c6-c3b9-4bb9-a966-39bb61bf04d8', 'ec305099-c682-442d-bc25-f4f972544d53', 'b51e5105-c289-4304-9fc8-c510b67b17f0', '587b9ffe-fe08-4c75-b923-939c84f5c702'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:18 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:18 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:18 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:18 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "cinder-cd0251a4-4d71-4c36-98e7-c02170c890f5-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-cd0251a4-4d71-4c36-98e7-c02170c890f5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-129f8399-8971-49bf-9db0-9519bb1286e0-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "cinder-quobyte-cd0251a4-4d71-4c36-98e7-c02170c890f5" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Lock "cinder-129f8399-8971-49bf-9db0-9519bb1286e0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-quobyte-cd0251a4-4d71-4c36-98e7-c02170c890f5" acquired by "delete_volume" :: waited 0.040s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:18 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.400s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:18 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c29f34-9311-4d56-8998-4a95dc1565b5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-quobyte-129f8399-8971-49bf-9db0-9519bb1286e0" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.533s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Deleted volume successfully. Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-129f8399-8971-49bf-9db0-9519bb1286e0" acquired by "delete_volume" :: waited 0.038s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ac8e6dc-b1dc-436d-857c-120b7c0c375a tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-5c223f8b-87f5-463d-baff-b7d49f6dfcea-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a403d5e-9862-4896-9978-11e2cac0ac88]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:19 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5 Aug 01 15:05:19 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:19 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0 Aug 01 15:05:19 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:19 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5" returned: 0 in 0.418s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:19 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5 Aug 01 15:05:19 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:19 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0" returned: 0 in 0.408s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:19 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0 Aug 01 15:05:19 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:19 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cd0251a4-4d71-4c36-98e7-c02170c890f5" returned: 0 in 0.261s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-quobyte-cd0251a4-4d71-4c36-98e7-c02170c890f5" released by "delete_volume" :: held 0.761s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Created reservations ['c6f67e8a-e5bd-41fb-8167-3bd0e7b3b83e', 'c1fa2339-b99c-4db5-99cc-b97c5f09308e', 'aa1121e9-7a89-4310-98b1-bb8aadb7cba6', '8a04743d-fc93-4d83-9367-6bda6158b255'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:19 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-129f8399-8971-49bf-9db0-9519bb1286e0" returned: 0 in 0.281s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-129f8399-8971-49bf-9db0-9519bb1286e0" released by "delete_volume" :: held 0.762s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:19 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:19 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:19 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Created reservations ['7afc4d58-4d36-4129-9742-0c2d86687902', 'b4059e6b-1524-4961-8c5d-90cbf1500995', 'e93fe4b6-cc7c-4523-b167-48df81902d67', '514b04ed-605b-4612-90f3-b4dc6923e634'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:20 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:20 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "cinder-3f196f33-365d-4360-b49d-b62b998f12a5-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-3f196f33-365d-4360-b49d-b62b998f12a5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-07abecbc-a931-49e2-a7b8-0b52c9cb5a73-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Lock "cinder-07abecbc-a931-49e2-a7b8-0b52c9cb5a73-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:20 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.429s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "cinder-quobyte-3f196f33-365d-4360-b49d-b62b998f12a5" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:20 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Deleted volume successfully. Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-quobyte-3f196f33-365d-4360-b49d-b62b998f12a5" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eee8c9d2-2396-4acc-b823-d721436fcaf6 tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-cd0251a4-4d71-4c36-98e7-c02170c890f5-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Acquiring lock "cinder-quobyte-07abecbc-a931-49e2-a7b8-0b52c9cb5a73" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfbc33d-6406-4b15-b5e7-b6bbe5696ac9]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-07abecbc-a931-49e2-a7b8-0b52c9cb5a73" acquired by "delete_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d0ffa9-f5d0-4e85-a4a8-e817b2ff7da7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:20 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.407s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:20 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Deleted volume successfully. Aug 01 15:05:20 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5 Aug 01 15:05:20 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-842ed60e-5e82-43c2-8231-30f838acf9c5 tempest-VolumesGetTest-2114708775 None] Lock "cinder-129f8399-8971-49bf-9db0-9519bb1286e0-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:20 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 Aug 01 15:05:20 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:20 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5" returned: 0 in 0.458s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:20 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5 Aug 01 15:05:20 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:20 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73" returned: 0 in 0.508s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:21 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73 Aug 01 15:05:21 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:21 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:21 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-07abecbc-a931-49e2-a7b8-0b52c9cb5a73" returned: 0 in 0.451s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3f196f33-365d-4360-b49d-b62b998f12a5" returned: 0 in 0.573s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Lock "cinder-quobyte-07abecbc-a931-49e2-a7b8-0b52c9cb5a73" released by "delete_volume" :: held 1.055s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-quobyte-3f196f33-365d-4360-b49d-b62b998f12a5" released by "delete_volume" :: held 1.139s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Created reservations ['79174c3b-f5b5-4077-9cec-f470b4fc8781', '770343ae-4642-493f-bad8-4ddb4a3fbfb6', '39f0ec1a-2c5b-4a75-9467-5a7e33f11416', '0e4672db-b59a-4a51-93b0-08f1b2c931db'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Created reservations ['6bab04e5-4254-4347-99e4-11cf02853548', 'bc5ee75a-db0b-4345-bd47-d9443b73f17b', '7fc3a28e-d031-4509-8349-a8ed7e3a07b7', 'b5c0c713-2202-452b-a5f3-252525315e64'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:21 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:21 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:21 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:21 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:22 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.380s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:22 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:22 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Deleted volume successfully. Aug 01 15:05:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9fa91d05-21c4-4dd6-9a63-9c6366190c84 tempest-AttachVolumeTestJSON-1116048949 None] Lock "cinder-3f196f33-365d-4360-b49d-b62b998f12a5-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:22 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.418s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:22 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:22 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Deleted volume successfully. Aug 01 15:05:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4db750fb-18bd-4904-881e-5988718926aa tempest-VolumesGetTest-2114708775 None] Lock "cinder-07abecbc-a931-49e2-a7b8-0b52c9cb5a73-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Flow 'volume_create_manager' (7ed6bade-5b00-4ffa-8c16-ec3f0fedcaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4c3a93-80ce-491a-bce3-dd5c50200db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4c3a93-80ce-491a-bce3-dd5c50200db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-13268572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582d5c1b-e164-4149-abda-a4a01abdd0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33819a3a5724e22984f3fe40597a134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:28Z,use_quota=True,user_id='a8999477f142468086cb05c55d3967fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6091dc7-793c-475f-9f42-fd305d5b71ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6091dc7-793c-475f-9f42-fd305d5b71ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50012cc5-dd67-4234-8b3c-d53cc96fe815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50012cc5-dd67-4234-8b3c-d53cc96fe815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '582d5c1b-e164-4149-abda-a4a01abdd0b2', 'volume_name': 'volume-582d5c1b-e164-4149-abda-a4a01abdd0b2', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90de948-1966-4d21-ad8a-2cfbe39cbf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90de948-1966-4d21-ad8a-2cfbe39cbf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4513cc63-4274-4321-a3b9-fba2c0e721a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:27 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Volume 582d5c1b-e164-4149-abda-a4a01abdd0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-582d5c1b-e164-4149-abda-a4a01abdd0b2', 'volume_size': 1} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-13268572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582d5c1b-e164-4149-abda-a4a01abdd0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33819a3a5724e22984f3fe40597a134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:28Z,use_quota=True,user_id='a8999477f142468086cb05c55d3967fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Creating volume 582d5c1b-e164-4149-abda-a4a01abdd0b2 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:05:27 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:05:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:28 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2 1073741824 Aug 01 15:05:28 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:28 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2 1073741824" returned: 0 in 0.807s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:28 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2 Aug 01 15:05:28 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:29 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2" returned: 0 in 0.326s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:05:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4513cc63-4274-4321-a3b9-fba2c0e721a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-582d5c1b-e164-4149-abda-a4a01abdd0b2', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d1f1a4-12b1-454c-8422-e673b7251b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:29 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Volume volume-582d5c1b-e164-4149-abda-a4a01abdd0b2 (582d5c1b-e164-4149-abda-a4a01abdd0b2): created successfully Aug 01 15:05:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d1f1a4-12b1-454c-8422-e673b7251b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Flow 'volume_create_manager' (7ed6bade-5b00-4ffa-8c16-ec3f0fedcaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:29 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-25781e9a-2b39-4a46-8dc6-26d537ccea95 tempest-VolumesNegativeTest-822485312 None] Created volume successfully. Aug 01 15:05:32 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-3ea7d1db-e653-4d57-834e-4eb3da36addc tempest-ServerActionsTestOtherA-225605167 None] Terminate volume connection completed successfully. Aug 01 15:05:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-3ea7d1db-e653-4d57-834e-4eb3da36addc tempest-ServerActionsTestOtherA-225605167 None] Deleting attachment 13967493-5186-41ad-8811-a976f7b35065. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:05:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "cinder-58426b0f-c034-467e-8f0a-7e090a44d6c0-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Lock "cinder-58426b0f-c034-467e-8f0a-7e090a44d6c0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "cinder-quobyte-58426b0f-c034-467e-8f0a-7e090a44d6c0" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Lock "cinder-quobyte-58426b0f-c034-467e-8f0a-7e090a44d6c0" acquired by "delete_volume" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf914cb-da8f-4195-8615-41aa820765db]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:32 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 Aug 01 15:05:32 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:33 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0" returned: 0 in 0.688s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:33 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0 Aug 01 15:05:33 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:33 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-58426b0f-c034-467e-8f0a-7e090a44d6c0" returned: 0 in 0.373s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Lock "cinder-quobyte-58426b0f-c034-467e-8f0a-7e090a44d6c0" released by "delete_volume" :: held 1.135s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:33 devstack cinder-volume[89024]: DEBUG cinder.quota [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Created reservations ['d7897e8a-3b3b-4a2d-977d-1fec957f7cf0', 'fbf4ceca-236e-45fb-b9a8-67d57b6cc995', '8acdcd43-24da-475c-bc3e-8a3aaef62fea', '0cdff821-d26e-4a51-989a-5a0249d3ee91'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:34 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:34 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:34 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.541s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.manager [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:34 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Deleted volume successfully. Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-1602f63c-622e-4e5f-b52c-16385ab8a814 req-89b2518b-d960-4db1-8e1a-eebaa3887323 tempest-ServerActionsTestOtherA-225605167 None] Lock "cinder-58426b0f-c034-467e-8f0a-7e090a44d6c0-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Flow 'volume_create_manager' (ec8b6cca-753f-4514-83aa-929df38e69be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9e289a-e3d0-4135-9eed-c573c923f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "cinder-94918afb-c550-42b9-b7d0-a8f2033f775a-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9e289a-e3d0-4135-9eed-c573c923f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1289944314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356ed87c-9ea6-4b9e-b675-e86eb83877ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372c80a9046d44ffa5c94e551ac37f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:35Z,use_quota=True,user_id='75503afb87e04390ab5b3d128d570f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f36606-0a3b-46bb-ad82-81915f8688c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f36606-0a3b-46bb-ad82-81915f8688c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b29eb8-1392-488f-8327-3ce63774dc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b29eb8-1392-488f-8327-3ce63774dc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '356ed87c-9ea6-4b9e-b675-e86eb83877ad', 'volume_name': 'volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ca3117-2c4b-41c6-b3d3-15dab898e386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ca3117-2c4b-41c6-b3d3-15dab898e386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e73de22-8bc6-4f2a-9cd6-eb982f8824b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:34 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Volume 356ed87c-9ea6-4b9e-b675-e86eb83877ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad', 'volume_size': 1} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1289944314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356ed87c-9ea6-4b9e-b675-e86eb83877ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372c80a9046d44ffa5c94e551ac37f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:35Z,use_quota=True,user_id='75503afb87e04390ab5b3d128d570f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Creating volume 356ed87c-9ea6-4b9e-b675-e86eb83877ad {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:05:34 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:34 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad 1073741824 Aug 01 15:05:34 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Lock "cinder-94918afb-c550-42b9-b7d0-a8f2033f775a-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "cinder-quobyte-94918afb-c550-42b9-b7d0-a8f2033f775a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Lock "cinder-quobyte-94918afb-c550-42b9-b7d0-a8f2033f775a" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8c5f3d-8509-48ef-993a-a9d2efd12edb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:35 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a Aug 01 15:05:35 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:35 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a" returned: 0 in 0.487s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:35 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad 1073741824" returned: 0 in 0.672s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:35 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a Aug 01 15:05:35 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:35 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad Aug 01 15:05:35 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:35 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94918afb-c550-42b9-b7d0-a8f2033f775a" returned: 0 in 0.442s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:35 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Lock "cinder-quobyte-94918afb-c550-42b9-b7d0-a8f2033f775a" released by "delete_volume" :: held 0.995s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad" returned: 0 in 0.410s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e73de22-8bc6-4f2a-9cd6-eb982f8824b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15bc644-0472-48f7-8b17-7cc8afa27006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:35 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Volume volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad (356ed87c-9ea6-4b9e-b675-e86eb83877ad): created successfully Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15bc644-0472-48f7-8b17-7cc8afa27006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Flow 'volume_create_manager' (ec8b6cca-753f-4514-83aa-929df38e69be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:36 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-c28d7429-18cb-4e73-87e5-ca62e7da7791 req-07ba1680-2791-44df-8cc2-aab4e9cf428b tempest-VolumesSnapshotsTestJSON-2027648251 None] Created volume successfully. Aug 01 15:05:36 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Created reservations ['9ff8ed86-0976-455a-8b32-a3f1cf4214ec', '4580abed-ce65-41b7-b215-d45fa0c1983a', 'e37e5d18-4890-4f81-b658-dff224610322', '9bfe011f-e64c-433f-bc95-4a7e7952b959'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:36 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:36 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:36 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.338s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:36 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:36 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Deleted volume successfully. Aug 01 15:05:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a531af7-8f4b-4117-8d08-f9e9db8f48ba tempest-ServerActionsTestOtherA-225605167 None] Lock "cinder-94918afb-c550-42b9-b7d0-a8f2033f775a-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] Creating offline snapshot 070ed858-7b3b-4e74-943a-47da74a693c7 of volume 356ed87c-9ea6-4b9e-b675-e86eb83877ad {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:05:37 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2b6858-29b2-4690-b7db-ee5d3ba77bab]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:37 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad Aug 01 15:05:37 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:37 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad" returned: 0 in 0.593s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:37 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 1G Aug 01 15:05:37 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:38 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 1G" returned: 0 in 0.830s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:38 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 Aug 01 15:05:38 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:39 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7" returned: 0 in 0.537s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:39 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 is being set with open permissions: ugo+rw Aug 01 15:05:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:39 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 Aug 01 15:05:39 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:39 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7" returned: 0 in 0.510s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:39 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.info Aug 01 15:05:39 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:40 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.info" returned: 0 in 0.315s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:40 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.info is being set with open permissions: ugo+rw Aug 01 15:05:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:40 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.info Aug 01 15:05:40 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:40 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.info" returned: 0 in 0.277s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.205s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-a4c56703-7ca0-4f4f-aa8c-393064ac8c33 req-ca30c131-d880-463d-a8bf-dd7096de6953 tempest-VolumesSnapshotsTestJSON-2027648251 None] Create snapshot completed successfully Aug 01 15:05:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Acquiring lock "cinder-070ed858-7b3b-4e74-943a-47da74a693c7-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "cinder-070ed858-7b3b-4e74-943a-47da74a693c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Acquiring lock "cinder-quobyte-356ed87c-9ea6-4b9e-b675-e86eb83877ad" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "cinder-quobyte-356ed87c-9ea6-4b9e-b675-e86eb83877ad" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Acquiring lock "cinder-quobyte-070ed858-7b3b-4e74-943a-47da74a693c7" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "cinder-quobyte-070ed858-7b3b-4e74-943a-47da74a693c7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Deleting offline snapshot 070ed858-7b3b-4e74-943a-47da74a693c7 of volume 356ed87c-9ea6-4b9e-b675-e86eb83877ad {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] snapshot_file for this snap is: volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfa76f2-c389-4a6c-8feb-bd543fa9e2a3]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:41 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 Aug 01 15:05:41 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:41 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7" returned: 0 in 0.417s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f611dbd-3d8b-428c-ad8d-f71d773db49f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:41 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad Aug 01 15:05:41 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:42 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad" returned: 0 in 0.486s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:42 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 Aug 01 15:05:42 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:42 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7" returned: 0 in 0.503s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:42 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7 Aug 01 15:05:42 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:42 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad.070ed858-7b3b-4e74-943a-47da74a693c7" returned: 0 in 0.329s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "cinder-quobyte-070ed858-7b3b-4e74-943a-47da74a693c7" released by "_delete_snapshot" :: held 1.895s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "cinder-quobyte-356ed87c-9ea6-4b9e-b675-e86eb83877ad" released by "delete_snapshot" :: held 1.926s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:43 devstack cinder-volume[89024]: WARNING cinder.quota [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:05:43 devstack cinder-volume[89024]: DEBUG cinder.quota [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Created reservations ['be56e040-8584-42fb-b9de-7eee880a9b99', '0a660cd0-fe82-4616-ae72-11c2540a3930', '31e29940-7477-4efc-9873-cac33d0a0287', 'e94d83ba-fc48-4ec5-a5fe-be1cb0759741'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Delete snapshot completed successfully. Aug 01 15:05:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-553a5c99-712b-4830-b41c-db7be3105cf2 req-2ffd00ea-6ff8-4a0c-8789-851bfd60f11d tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "cinder-070ed858-7b3b-4e74-943a-47da74a693c7-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Acquiring lock "cinder-356ed87c-9ea6-4b9e-b675-e86eb83877ad-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "cinder-356ed87c-9ea6-4b9e-b675-e86eb83877ad-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Acquiring lock "cinder-quobyte-356ed87c-9ea6-4b9e-b675-e86eb83877ad" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "cinder-quobyte-356ed87c-9ea6-4b9e-b675-e86eb83877ad" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[446a5285-749d-465a-b197-3c582c28e369]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:43 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad Aug 01 15:05:43 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:44 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad" returned: 0 in 0.575s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:44 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad Aug 01 15:05:44 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:44 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-356ed87c-9ea6-4b9e-b675-e86eb83877ad" returned: 0 in 0.447s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "cinder-quobyte-356ed87c-9ea6-4b9e-b675-e86eb83877ad" released by "delete_volume" :: held 1.124s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:44 devstack cinder-volume[89024]: DEBUG cinder.quota [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Created reservations ['e8041189-5188-4ac0-a4eb-9115f041046a', '0d339063-c9f1-4130-a895-b9f528bc7f69', 'd2f33d11-f9f3-4c18-9a9d-a9a339bc8670', 'a9493ee7-f594-4db6-8418-50d03f4627ae'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:44 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:44 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:45 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.294s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:45 devstack cinder-volume[89024]: DEBUG cinder.manager [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Deleted volume successfully. Aug 01 15:05:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-88161d3c-3ba0-4ea1-8703-0129e34a73a3 req-932b639c-a729-41e7-8f5f-15b46acbf4ba tempest-VolumesSnapshotsTestJSON-2027648251 None] Lock "cinder-356ed87c-9ea6-4b9e-b675-e86eb83877ad-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Acquiring lock "cinder-e619132a-644d-43a7-830e-8b131be80ae0-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Lock "cinder-e619132a-644d-43a7-830e-8b131be80ae0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Acquiring lock "cinder-quobyte-e619132a-644d-43a7-830e-8b131be80ae0" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Lock "cinder-quobyte-e619132a-644d-43a7-830e-8b131be80ae0" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8347cc79-99b8-47bb-8459-283989cc6da3]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:51 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0 Aug 01 15:05:51 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:51 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0" returned: 0 in 0.419s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:51 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0 Aug 01 15:05:51 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:51 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e619132a-644d-43a7-830e-8b131be80ae0" returned: 0 in 0.298s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Lock "cinder-quobyte-e619132a-644d-43a7-830e-8b131be80ae0" released by "delete_volume" :: held 0.768s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:52 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Created reservations ['35920805-96f1-47ac-896d-6c3ee1482d71', '4c8ab306-a05e-4443-9886-663ad6d9253e', '04e77cc3-aa39-4888-90ac-a4df9abcea5d', 'be1267d6-5b65-4e0f-845f-36a0d073ccad'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:52 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:52 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-080d1dc1-521d-4fe1-ab78-c5e36c2f81a7 tempest-GroupsTest-827592192 None] Group tempest-Group1-1147948852: creating Aug 01 15:05:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-080d1dc1-521d-4fe1-ab78-c5e36c2f81a7 tempest-GroupsTest-827592192 None] Group tempest-Group1-1147948852: created successfully Aug 01 15:05:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-080d1dc1-521d-4fe1-ab78-c5e36c2f81a7 tempest-GroupsTest-827592192 None] Create group completed successfully. Aug 01 15:05:52 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.292s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:52 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Deleted volume successfully. Aug 01 15:05:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-87fe0b32-b5ae-4c40-9732-a128e2c9f9c4 tempest-AttachVolumeShelveTestJSON-1849564344 None] Lock "cinder-e619132a-644d-43a7-830e-8b131be80ae0-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Flow 'volume_create_manager' (a3cbbe63-a29e-4774-a51f-75a1d0d2969c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d54f52-a488-4d63-b741-ed1f53586171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d54f52-a488-4d63-b741-ed1f53586171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-533221084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842f4277-9ced-4906-817b-ac92f0f029e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='145200f184fe489294272b5cb51911e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:53Z,use_quota=True,user_id='d150bcd2648345b7a68c4db0d68d44b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0c3727-303c-4713-9b55-e9c3881f4bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0c3727-303c-4713-9b55-e9c3881f4bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e75fcf9-9ac5-4b0d-a0ec-f7017c276b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e75fcf9-9ac5-4b0d-a0ec-f7017c276b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842f4277-9ced-4906-817b-ac92f0f029e9', 'volume_name': 'volume-842f4277-9ced-4906-817b-ac92f0f029e9', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ba5f00-ffaf-4c1d-9e1c-1c0c9f16cda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ba5f00-ffaf-4c1d-9e1c-1c0c9f16cda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df2a838-77f6-43f2-86a1-d4031b3077c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:53 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Volume 842f4277-9ced-4906-817b-ac92f0f029e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842f4277-9ced-4906-817b-ac92f0f029e9', 'volume_size': 1} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-533221084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842f4277-9ced-4906-817b-ac92f0f029e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='145200f184fe489294272b5cb51911e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:53Z,use_quota=True,user_id='d150bcd2648345b7a68c4db0d68d44b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Creating volume 842f4277-9ced-4906-817b-ac92f0f029e9 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:05:53 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:53 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9 1073741824 Aug 01 15:05:53 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b9c43d6d-2946-4106-8839-f1a0c6e6d5a6 tempest-GroupsTest-827592192 None] Group tempest-Group2-236856599: creating Aug 01 15:05:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b9c43d6d-2946-4106-8839-f1a0c6e6d5a6 tempest-GroupsTest-827592192 None] Group tempest-Group2-236856599: created successfully Aug 01 15:05:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b9c43d6d-2946-4106-8839-f1a0c6e6d5a6 tempest-GroupsTest-827592192 None] Create group completed successfully. Aug 01 15:05:53 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9 1073741824" returned: 0 in 0.632s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:53 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9 Aug 01 15:05:53 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:54 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9" returned: 0 in 0.326s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:05:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df2a838-77f6-43f2-86a1-d4031b3077c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842f4277-9ced-4906-817b-ac92f0f029e9', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319c5928-5368-4a77-b349-a0138d1335cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:54 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Volume volume-842f4277-9ced-4906-817b-ac92f0f029e9 (842f4277-9ced-4906-817b-ac92f0f029e9): created successfully Aug 01 15:05:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319c5928-5368-4a77-b349-a0138d1335cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Flow 'volume_create_manager' (a3cbbe63-a29e-4774-a51f-75a1d0d2969c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-968ccc31-26d8-4f2c-864a-9347dfc7ba37 req-92ca78ee-9cf9-47e0-90d1-55718fd155ba tempest-VolumesGetTestJSON-177136272 None] Created volume successfully. Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Acquiring lock "cinder-582d5c1b-e164-4149-abda-a4a01abdd0b2-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Lock "cinder-582d5c1b-e164-4149-abda-a4a01abdd0b2-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Acquiring lock "cinder-quobyte-582d5c1b-e164-4149-abda-a4a01abdd0b2" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Lock "cinder-quobyte-582d5c1b-e164-4149-abda-a4a01abdd0b2" acquired by "delete_volume" :: waited 0.045s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcebf67-14e8-4aeb-9b0c-8b0a4b9ebffb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Flow 'volume_create_manager' (8190ac41-c423-4c14-afa1-65653c76bb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169c805b-7ef0-449b-888c-bc89968ec10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169c805b-7ef0-449b-888c-bc89968ec10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2100348258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e21bf12-bd23-4db7-9f62-18e5bbae137f,host='devstack@QuobyteHD#QuobyteHD',id=b11b1c18-3d10-4d4d-ad61-28d560e5a396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8057d0844ba4a8dbd3901bc08068705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:55Z,use_quota=True,user_id='3206aabcd3d84a689752f7226f8edd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fe410c0-cb07-4831-97d9-7e095a359964),volume_type_id=8fe410c0-cb07-4831-97d9-7e095a359964)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1282e615-cae8-495f-ab4d-3748b41cb8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1282e615-cae8-495f-ab4d-3748b41cb8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fcc4f5-cd56-4feb-a9e6-aeadef599b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fcc4f5-cd56-4feb-a9e6-aeadef599b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b11b1c18-3d10-4d4d-ad61-28d560e5a396', 'volume_name': 'volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f0f188-c597-4143-99c3-59b77b651e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f0f188-c597-4143-99c3-59b77b651e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19686ddd-0672-4199-83b0-1f6082e0c599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:55 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Volume b11b1c18-3d10-4d4d-ad61-28d560e5a396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396', 'volume_size': 1} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e21bf12-bd23-4db7-9f62-18e5bbae137f,created_at=2026-08-01T13:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2100348258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e21bf12-bd23-4db7-9f62-18e5bbae137f,host='devstack@QuobyteHD#QuobyteHD',id=b11b1c18-3d10-4d4d-ad61-28d560e5a396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8057d0844ba4a8dbd3901bc08068705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:05:55Z,use_quota=True,user_id='3206aabcd3d84a689752f7226f8edd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fe410c0-cb07-4831-97d9-7e095a359964),volume_type_id=8fe410c0-cb07-4831-97d9-7e095a359964)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Creating volume b11b1c18-3d10-4d4d-ad61-28d560e5a396 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:05:55 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:55 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2 Aug 01 15:05:55 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:55 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396 1073741824 Aug 01 15:05:55 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Acquiring lock "cinder-842f4277-9ced-4906-817b-ac92f0f029e9-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Lock "cinder-842f4277-9ced-4906-817b-ac92f0f029e9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Acquiring lock "cinder-quobyte-842f4277-9ced-4906-817b-ac92f0f029e9" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Lock "cinder-quobyte-842f4277-9ced-4906-817b-ac92f0f029e9" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b52633-8f02-4100-a993-c737b03631fc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:55 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9 Aug 01 15:05:55 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:55 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2" returned: 0 in 0.651s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:56 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2 Aug 01 15:05:56 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:56 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396 1073741824" returned: 0 in 0.695s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:56 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396 Aug 01 15:05:56 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:56 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9" returned: 0 in 0.528s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:56 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9 Aug 01 15:05:56 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:56 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-582d5c1b-e164-4149-abda-a4a01abdd0b2" returned: 0 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Lock "cinder-quobyte-582d5c1b-e164-4149-abda-a4a01abdd0b2" released by "delete_volume" :: held 1.064s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Created reservations ['37a99e2b-06bb-4e76-b26e-736e78ddd624', '1ce871fb-df31-4c28-9b55-033031ac7023', '56bc93cb-0141-4116-9cf0-b1467a5fa678', 'fce705c7-cbfe-4f7b-8689-a215391fbeee'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:56 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-842f4277-9ced-4906-817b-ac92f0f029e9" returned: 0 in 0.279s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Lock "cinder-quobyte-842f4277-9ced-4906-817b-ac92f0f029e9" released by "delete_volume" :: held 0.876s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:56 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396" returned: 0 in 0.429s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:56 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:56 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19686ddd-0672-4199-83b0-1f6082e0c599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0190b08a-de79-40cb-9b17-417548e70166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:05:56 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Volume volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396 (b11b1c18-3d10-4d4d-ad61-28d560e5a396): created successfully Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0190b08a-de79-40cb-9b17-417548e70166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Flow 'volume_create_manager' (8190ac41-c423-4c14-afa1-65653c76bb8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:05:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-181ec8f1-2787-488a-9afb-36dcde5449c6 tempest-GroupsTest-827592192 None] Created volume successfully. Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.quota [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Created reservations ['ca35133c-9b19-4106-ad9a-7f61f9a78d75', '559865b7-240c-440f-892b-113beebf58b2', '0b849ed8-1843-4f4f-9e47-467422aa365f', 'dcc1fddd-4749-4047-9d85-8a6d35ee742e'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:56 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:56 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:56 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.320s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Deleted volume successfully. Aug 01 15:05:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e1757b50-7b2a-484d-a7df-8bf9b1805bd1 tempest-VolumesNegativeTest-822485312 None] Lock "cinder-582d5c1b-e164-4149-abda-a4a01abdd0b2-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:57 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.364s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:57 devstack cinder-volume[89024]: DEBUG cinder.manager [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:05:57 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Deleted volume successfully. Aug 01 15:05:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-b43940cf-43ad-43d2-b33e-b40c8936337e req-bc80faa7-7c3a-4d9c-934c-de616c9ee267 tempest-VolumesGetTestJSON-177136272 None] Lock "cinder-842f4277-9ced-4906-817b-ac92f0f029e9-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Acquiring lock "cinder-quobyte-b11b1c18-3d10-4d4d-ad61-28d560e5a396" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:05:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Lock "cinder-quobyte-b11b1c18-3d10-4d4d-ad61-28d560e5a396" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:05:58 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2cd16c-fc0f-4899-833f-8892db414177]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:05:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:58 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396 Aug 01 15:05:58 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:59 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396" returned: 0 in 0.512s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:59 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396 Aug 01 15:05:59 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:59 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b11b1c18-3d10-4d4d-ad61-28d560e5a396" returned: 0 in 0.280s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Lock "cinder-quobyte-b11b1c18-3d10-4d4d-ad61-28d560e5a396" released by "delete_volume" :: held 0.856s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Created reservations ['fb907307-9b49-4017-a214-df2e3c2e69bc'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:59 devstack cinder-volume[89024]: WARNING cinder.quota [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1091812634 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1091812634, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:05:59 devstack cinder-volume[89024]: WARNING cinder.quota [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1091812634 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1091812634, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Created reservations ['ca7519a0-12e5-4a0a-bf11-318931a7fa1d', 'fcf67bd1-28ea-4cef-ab64-750e177c9207', '52e3088f-db7a-4113-abf1-ae2e75d7d91d', '58018350-e67f-47bd-b18f-4b9ed7382589'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:05:59 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:05:59 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:05:59 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=145,cinder:SELECT=115,cinder:INSERT=40,cinder:DELETE=8 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:06:00 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-3a03a318-d702-4683-afba-855471a00e69 tempest-GroupsTest-827592192 None] Created reservations ['f7512766-b2ba-43fe-b4e0-d5dad9e41148'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:06:00 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.482s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:00 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:06:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-9393980f-590a-4bb2-a3dc-f57aa7f55675 tempest-GroupsTest-827592192 None] Delete group completed successfully. Aug 01 15:06:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3a03a318-d702-4683-afba-855471a00e69 tempest-GroupsTest-827592192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3a03a318-d702-4683-afba-855471a00e69 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3a03a318-d702-4683-afba-855471a00e69 tempest-GroupsTest-827592192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3a03a318-d702-4683-afba-855471a00e69 tempest-GroupsTest-827592192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3a03a318-d702-4683-afba-855471a00e69 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3a03a318-d702-4683-afba-855471a00e69 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:00 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:06:00 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:00 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3a03a318-d702-4683-afba-855471a00e69 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.314s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:00 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-3a03a318-d702-4683-afba-855471a00e69 tempest-GroupsTest-827592192 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:06:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3a03a318-d702-4683-afba-855471a00e69 tempest-GroupsTest-827592192 None] Delete group completed successfully. Aug 01 15:06:01 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-29708490-9a82-4ef7-8fd3-188fdc3caec4 tempest-GroupsTest-827592192 None] Group tempest-GroupsTest-Group-1176204793: creating Aug 01 15:06:01 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-29708490-9a82-4ef7-8fd3-188fdc3caec4 tempest-GroupsTest-827592192 None] Group tempest-GroupsTest-Group-1176204793: created successfully Aug 01 15:06:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-29708490-9a82-4ef7-8fd3-188fdc3caec4 tempest-GroupsTest-827592192 None] Create group completed successfully. Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Flow 'volume_create_manager' (6cfe0708-7659-471a-afbe-05e70ae32913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7db08e8-0efb-4710-a395-78999b52ef45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7db08e8-0efb-4710-a395-78999b52ef45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1797721488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4a8ec0-573f-48e7-92d6-2924a69ac129,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='828917d547fd4bc59288b28d34a978c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:02Z,use_quota=True,user_id='dd8f40d7f4a34ddaabc4e84e02946248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcaf0a1a-2c48-4010-8e53-cdd3a6f3f074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcaf0a1a-2c48-4010-8e53-cdd3a6f3f074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb72cd7-a2cf-4a93-818f-f10f4bb50ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb72cd7-a2cf-4a93-818f-f10f4bb50ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4a8ec0-573f-48e7-92d6-2924a69ac129', 'volume_name': 'volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe1cfc8-e359-4c8f-8544-d02532c83e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe1cfc8-e359-4c8f-8544-d02532c83e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613ec761-34fe-495d-a6da-aaca4680ebef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:02 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Volume 4e4a8ec0-573f-48e7-92d6-2924a69ac129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129', 'volume_size': 1} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1797721488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4a8ec0-573f-48e7-92d6-2924a69ac129,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='828917d547fd4bc59288b28d34a978c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:02Z,use_quota=True,user_id='dd8f40d7f4a34ddaabc4e84e02946248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Creating volume 4e4a8ec0-573f-48e7-92d6-2924a69ac129 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:02 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:02 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129 1073741824 Aug 01 15:06:02 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:02 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129 1073741824" returned: 0 in 0.584s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:03 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129 Aug 01 15:06:03 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:03 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129" returned: 0 in 0.359s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613ec761-34fe-495d-a6da-aaca4680ebef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5521a0-853c-428c-b29f-deebcaf6013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Volume volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129 (4e4a8ec0-573f-48e7-92d6-2924a69ac129): created successfully Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5521a0-853c-428c-b29f-deebcaf6013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Flow 'volume_create_manager' (6cfe0708-7659-471a-afbe-05e70ae32913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-89059204-2ea5-498b-86d8-08aa5551c2ce tempest-VolumesTestJSON-1014066057 None] Created volume successfully. Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Flow 'volume_create_manager' (999603e9-4acf-42d5-93c0-5a65a6e2cc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fcbb7c-5401-4a8a-8543-80bde3b5a4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fcbb7c-5401-4a8a-8543-80bde3b5a4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-227918790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d50d42a7-8dac-4c5d-a61d-b41067a01814,host='devstack@QuobyteHD#QuobyteHD',id=d8cd5220-1f69-4693-bfc4-d21b1d5618dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8057d0844ba4a8dbd3901bc08068705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:04Z,use_quota=True,user_id='3206aabcd3d84a689752f7226f8edd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcf48787-cc2c-488a-9c50-e3febad1b26e),volume_type_id=fcf48787-cc2c-488a-9c50-e3febad1b26e)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc98b17b-5122-40f8-8e4f-96088fcdaa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc98b17b-5122-40f8-8e4f-96088fcdaa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435d3d65-84f8-4eac-a3f2-5e4c7402da5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435d3d65-84f8-4eac-a3f2-5e4c7402da5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8cd5220-1f69-4693-bfc4-d21b1d5618dc', 'volume_name': 'volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a544cd7-99ed-4644-8637-9a02bd5a5fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a544cd7-99ed-4644-8637-9a02bd5a5fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c269ca7d-9676-426b-9e7b-f75d816cd949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Volume d8cd5220-1f69-4693-bfc4-d21b1d5618dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc', 'volume_size': 1} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d50d42a7-8dac-4c5d-a61d-b41067a01814,created_at=2026-08-01T13:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-227918790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d50d42a7-8dac-4c5d-a61d-b41067a01814,host='devstack@QuobyteHD#QuobyteHD',id=d8cd5220-1f69-4693-bfc4-d21b1d5618dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8057d0844ba4a8dbd3901bc08068705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:04Z,use_quota=True,user_id='3206aabcd3d84a689752f7226f8edd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcf48787-cc2c-488a-9c50-e3febad1b26e),volume_type_id=fcf48787-cc2c-488a-9c50-e3febad1b26e)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Creating volume d8cd5220-1f69-4693-bfc4-d21b1d5618dc {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:03 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:03 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc 1073741824 Aug 01 15:06:03 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:04 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc 1073741824" returned: 0 in 0.625s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:04 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc Aug 01 15:06:04 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:04 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc" returned: 0 in 0.523s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c269ca7d-9676-426b-9e7b-f75d816cd949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fbd4ba-dede-41dd-85da-7b697446407b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:05 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Volume volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc (d8cd5220-1f69-4693-bfc4-d21b1d5618dc): created successfully Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fbd4ba-dede-41dd-85da-7b697446407b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Flow 'volume_create_manager' (999603e9-4acf-42d5-93c0-5a65a6e2cc2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:05 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-89dcbe6b-6363-454a-b82c-1fb0121dbb92 tempest-GroupsTest-827592192 None] Created volume successfully. Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Flow 'volume_create_manager' (edf8287a-94d7-4f8a-ba05-f52859780af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed20dd88-21ca-497f-94b5-3f7ead4fb262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed20dd88-21ca-497f-94b5-3f7ead4fb262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-761426729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8497d9-9072-4eb3-8d41-5089fbcf2750,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='828917d547fd4bc59288b28d34a978c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:05Z,use_quota=True,user_id='dd8f40d7f4a34ddaabc4e84e02946248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2de9050-d6e1-43ef-8fcb-24b38feab510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2de9050-d6e1-43ef-8fcb-24b38feab510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbc4a43-77e1-4ac0-9127-0cf2064f89ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbc4a43-77e1-4ac0-9127-0cf2064f89ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8497d9-9072-4eb3-8d41-5089fbcf2750', 'volume_name': 'volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78024de5-aaa3-4218-8080-c01669a0b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78024de5-aaa3-4218-8080-c01669a0b890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af94db21-7221-4fc9-bb9d-7e1c48845c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:05 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Volume 6b8497d9-9072-4eb3-8d41-5089fbcf2750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750', 'volume_size': 1} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-761426729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8497d9-9072-4eb3-8d41-5089fbcf2750,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='828917d547fd4bc59288b28d34a978c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:05Z,use_quota=True,user_id='dd8f40d7f4a34ddaabc4e84e02946248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Creating volume 6b8497d9-9072-4eb3-8d41-5089fbcf2750 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:05 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:05 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750 1073741824 Aug 01 15:06:05 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:05 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750 1073741824" returned: 0 in 0.537s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:05 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750 Aug 01 15:06:05 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:06 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750" returned: 0 in 0.405s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af94db21-7221-4fc9-bb9d-7e1c48845c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9521308-ea6f-422d-bc79-c470035544e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:06 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Volume volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750 (6b8497d9-9072-4eb3-8d41-5089fbcf2750): created successfully Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9521308-ea6f-422d-bc79-c470035544e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Flow 'volume_create_manager' (edf8287a-94d7-4f8a-ba05-f52859780af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:06 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1a9a8e43-8c0c-4abc-a9c4-b8423bbabd47 tempest-VolumesTestJSON-1014066057 None] Created volume successfully. Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Flow 'volume_create_manager' (583827c1-bd06-40b4-a96f-9ae8caf962f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af562b6e-f3e9-4f33-9e86-4226c26f1ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af562b6e-f3e9-4f33-9e86-4226c26f1ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1509909264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d50d42a7-8dac-4c5d-a61d-b41067a01814,host='devstack@QuobyteHD#QuobyteHD',id=c9a7322d-478e-422f-9265-3736acb83102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8057d0844ba4a8dbd3901bc08068705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:07Z,use_quota=True,user_id='3206aabcd3d84a689752f7226f8edd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcf48787-cc2c-488a-9c50-e3febad1b26e),volume_type_id=fcf48787-cc2c-488a-9c50-e3febad1b26e)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8652891a-d1db-40c2-ae4a-c28c56b1842a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8652891a-d1db-40c2-ae4a-c28c56b1842a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdd9795-f436-483a-b2e9-3a3aacc590be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdd9795-f436-483a-b2e9-3a3aacc590be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a7322d-478e-422f-9265-3736acb83102', 'volume_name': 'volume-c9a7322d-478e-422f-9265-3736acb83102', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bcf5bd-c4a5-4e74-9569-803478491273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bcf5bd-c4a5-4e74-9569-803478491273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9524c6-040a-4140-8660-37cf1bd36986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:06 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Volume c9a7322d-478e-422f-9265-3736acb83102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a7322d-478e-422f-9265-3736acb83102', 'volume_size': 1} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d50d42a7-8dac-4c5d-a61d-b41067a01814,created_at=2026-08-01T13:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1509909264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d50d42a7-8dac-4c5d-a61d-b41067a01814,host='devstack@QuobyteHD#QuobyteHD',id=c9a7322d-478e-422f-9265-3736acb83102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8057d0844ba4a8dbd3901bc08068705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:07Z,use_quota=True,user_id='3206aabcd3d84a689752f7226f8edd52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcf48787-cc2c-488a-9c50-e3febad1b26e),volume_type_id=fcf48787-cc2c-488a-9c50-e3febad1b26e)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Creating volume c9a7322d-478e-422f-9265-3736acb83102 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:07 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:07 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102 1073741824 Aug 01 15:06:07 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:07 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102 1073741824" returned: 0 in 0.699s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:07 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102 Aug 01 15:06:07 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Flow 'volume_create_manager' (9b507b16-6753-46e0-a9ed-92924daa880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1749ac-de1f-4621-a0ba-9ff2ad9788c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba1749ac-de1f-4621-a0ba-9ff2ad9788c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1164498232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b9f02a-34fc-4b65-bc70-1d6dc200c889,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='828917d547fd4bc59288b28d34a978c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:08Z,use_quota=True,user_id='dd8f40d7f4a34ddaabc4e84e02946248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1e54b2-0c24-4ace-ac7e-d87ae7e8f84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1e54b2-0c24-4ace-ac7e-d87ae7e8f84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd744960-a78a-49d3-b42d-933699a848e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd744960-a78a-49d3-b42d-933699a848e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b9f02a-34fc-4b65-bc70-1d6dc200c889', 'volume_name': 'volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:08 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76b3838-de3e-4f2e-942b-34bf126ac5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76b3838-de3e-4f2e-942b-34bf126ac5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2389c9d1-b15c-4572-8cec-bfea9d3e6f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:08 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Volume e7b9f02a-34fc-4b65-bc70-1d6dc200c889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889', 'volume_size': 1} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102" returned: 0 in 0.567s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1164498232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b9f02a-34fc-4b65-bc70-1d6dc200c889,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='828917d547fd4bc59288b28d34a978c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:08Z,use_quota=True,user_id='dd8f40d7f4a34ddaabc4e84e02946248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Creating volume e7b9f02a-34fc-4b65-bc70-1d6dc200c889 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:08 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9524c6-040a-4140-8660-37cf1bd36986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a7322d-478e-422f-9265-3736acb83102', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffbc83e-8498-422e-9d6f-676aaf79a871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:08 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889 1073741824 Aug 01 15:06:08 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:08 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Volume volume-c9a7322d-478e-422f-9265-3736acb83102 (c9a7322d-478e-422f-9265-3736acb83102): created successfully Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffbc83e-8498-422e-9d6f-676aaf79a871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Flow 'volume_create_manager' (583827c1-bd06-40b4-a96f-9ae8caf962f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-587fed5c-fc82-453a-b028-68521371dd78 tempest-GroupsTest-827592192 None] Created volume successfully. Aug 01 15:06:08 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889 1073741824" returned: 0 in 0.648s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:09 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889 Aug 01 15:06:09 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:09 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889" returned: 0 in 0.323s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2389c9d1-b15c-4572-8cec-bfea9d3e6f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35032da7-32e4-40cd-a07e-08d55652b99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:09 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Volume volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889 (e7b9f02a-34fc-4b65-bc70-1d6dc200c889): created successfully Aug 01 15:06:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35032da7-32e4-40cd-a07e-08d55652b99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Flow 'volume_create_manager' (9b507b16-6753-46e0-a9ed-92924daa880f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b47170ab-ce56-49a7-9671-202aa00ab821 tempest-VolumesTestJSON-1014066057 None] Created volume successfully. Aug 01 15:06:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6b15882f-82cd-405b-8771-2542f49c41f1 tempest-GroupsTest-827592192 None] Update group completed successfully. Aug 01 15:06:11 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-aba87896-506f-4c4a-953e-a0c44a2e58ca tempest-GroupsTest-827592192 None] Update group completed successfully. Aug 01 15:06:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Acquiring lock "cinder-e7b9f02a-34fc-4b65-bc70-1d6dc200c889-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Lock "cinder-e7b9f02a-34fc-4b65-bc70-1d6dc200c889-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Acquiring lock "cinder-quobyte-e7b9f02a-34fc-4b65-bc70-1d6dc200c889" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Lock "cinder-quobyte-e7b9f02a-34fc-4b65-bc70-1d6dc200c889" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36d9f34-04fb-4fb8-bdc3-7e37586e5504]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:11 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889 Aug 01 15:06:11 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:11 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889" returned: 0 in 0.438s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:11 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889 Aug 01 15:06:11 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:12 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e7b9f02a-34fc-4b65-bc70-1d6dc200c889" returned: 0 in 0.349s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Lock "cinder-quobyte-e7b9f02a-34fc-4b65-bc70-1d6dc200c889" released by "delete_volume" :: held 0.856s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Created reservations ['c4658593-447c-4dd8-84c4-f81b94c23aa9', '856cbadf-1e8c-4485-8243-d8d0de681ec0', '51ce8597-08c4-4789-9a3d-a56350859298', '9f84e38c-1a8a-4015-9d92-ee21a6a21f2d'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:12 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:06:12 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Acquiring lock "cinder-6b8497d9-9072-4eb3-8d41-5089fbcf2750-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Lock "cinder-6b8497d9-9072-4eb3-8d41-5089fbcf2750-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Acquiring lock "cinder-quobyte-6b8497d9-9072-4eb3-8d41-5089fbcf2750" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Lock "cinder-quobyte-6b8497d9-9072-4eb3-8d41-5089fbcf2750" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:12 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.325s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[011d12aa-798c-4a6c-b3ad-03f2da8aa0da]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:12 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Deleted volume successfully. Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-29b5d08c-4381-4c20-85f7-6bb986ddd83d tempest-VolumesTestJSON-1014066057 None] Lock "cinder-e7b9f02a-34fc-4b65-bc70-1d6dc200c889-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:12 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750 Aug 01 15:06:12 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Acquiring lock "cinder-quobyte-c9a7322d-478e-422f-9265-3736acb83102" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Lock "cinder-quobyte-c9a7322d-478e-422f-9265-3736acb83102" acquired by "delete_volume" :: waited 0.042s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[47733d31-9b98-44df-937c-1be1fe5641f2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:13 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750" returned: 0 in 0.519s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:13 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750 Aug 01 15:06:13 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:13 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102 Aug 01 15:06:13 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:13 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8497d9-9072-4eb3-8d41-5089fbcf2750" returned: 0 in 0.303s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Lock "cinder-quobyte-6b8497d9-9072-4eb3-8d41-5089fbcf2750" released by "delete_volume" :: held 0.900s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Created reservations ['9d163587-efe7-427c-8175-9625f217c7b9', '94368402-3282-44f6-bd48-de5869b0fce0', '2b989beb-60b7-4e6d-9f70-a71b74fcecf7', 'f5f0e163-2a81-48e8-8886-b87f4230e190'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:06:13 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102" returned: 0 in 0.560s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:13 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102 Aug 01 15:06:13 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:13 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:06:13 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:14 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c9a7322d-478e-422f-9265-3736acb83102" returned: 0 in 0.368s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Lock "cinder-quobyte-c9a7322d-478e-422f-9265-3736acb83102" released by "delete_volume" :: held 1.008s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Acquiring lock "cinder-quobyte-d8cd5220-1f69-4693-bfc4-d21b1d5618dc" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:14 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.357s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Lock "cinder-quobyte-d8cd5220-1f69-4693-bfc4-d21b1d5618dc" acquired by "delete_volume" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:14 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Deleted volume successfully. Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caa1825-5683-4d74-814b-8eff6ded5b2e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb7ae1aa-6a4e-4312-98c4-2d84b77fbfd3 tempest-VolumesTestJSON-1014066057 None] Lock "cinder-6b8497d9-9072-4eb3-8d41-5089fbcf2750-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:14 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc Aug 01 15:06:14 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:14 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc" returned: 0 in 0.432s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:14 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc Aug 01 15:06:14 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Acquiring lock "cinder-4e4a8ec0-573f-48e7-92d6-2924a69ac129-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Lock "cinder-4e4a8ec0-573f-48e7-92d6-2924a69ac129-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=125,cinder:INSERT=44,cinder:UPDATE=160,cinder:DELETE=15 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:06:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Acquiring lock "cinder-quobyte-4e4a8ec0-573f-48e7-92d6-2924a69ac129" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Lock "cinder-quobyte-4e4a8ec0-573f-48e7-92d6-2924a69ac129" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:15 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8cd5220-1f69-4693-bfc4-d21b1d5618dc" returned: 0 in 0.400s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Lock "cinder-quobyte-d8cd5220-1f69-4693-bfc4-d21b1d5618dc" released by "delete_volume" :: held 0.891s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ff9136-ad2d-4f2f-9e92-07862ef07b13]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Created reservations ['48c5c67b-8e33-463e-adbb-85c5f48ce182'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:06:15 devstack cinder-volume[89024]: WARNING cinder.quota [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1651696859 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1651696859, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:06:15 devstack cinder-volume[89024]: WARNING cinder.quota [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1651696859 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1651696859, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Created reservations ['f75da66e-8232-49cb-9b3e-ac09e7e99f11', 'e64a8c81-95e7-4259-a350-2c957b0e980a', 'c24eaae7-abfe-473c-bcac-de20b93785df', 'ec631a11-30fb-4916-8471-b81c3d986f64'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:06:15 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129 Aug 01 15:06:15 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Created reservations ['69e00370-bbca-4b2c-aa45-43d240b3ee66', '2dafcc9d-9c39-4eb1-9f6b-c74d585917a8', '90632908-cb15-453a-b9de-46ba941ef3b9', '51d0359f-5ef0-494f-bade-cb3a8c10dc6f'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:15 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:06:15 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:15 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129" returned: 0 in 0.564s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:15 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129 Aug 01 15:06:15 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:16 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.553s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:06:16 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-34e49dac-619c-455d-9d62-35180f778ef0 tempest-GroupsTest-827592192 None] Delete group completed successfully. Aug 01 15:06:16 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4e4a8ec0-573f-48e7-92d6-2924a69ac129" returned: 0 in 0.494s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Lock "cinder-quobyte-4e4a8ec0-573f-48e7-92d6-2924a69ac129" released by "delete_volume" :: held 1.139s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Created reservations ['24c72e97-02dd-4899-af13-11e610a12590', '3b08c897-c88e-4d67-a225-1cee92d36b4f', 'e185ca4f-f1a4-4f2e-ba66-1afbab055c39', 'bb107b09-3201-4c56-bc23-9bb20f10895b'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:16 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:06:16 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:16 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.297s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:06:16 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Deleted volume successfully. Aug 01 15:06:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8805fd-05be-4ae9-9d99-0306baeb6059 tempest-VolumesTestJSON-1014066057 None] Lock "cinder-4e4a8ec0-573f-48e7-92d6-2924a69ac129-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:18 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:06:18 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:18 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.296s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:06:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:06:26 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=16,cinder:UPDATE=25,cinder:INSERT=5 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:06:26 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=47,cinder:UPDATE=63,cinder:INSERT=15,cinder:DELETE=4 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Flow 'volume_create_manager' (0d536dc5-27bb-4f2b-bddb-7395b6913040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046b515d-37bc-4c89-94e7-8742a6184776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046b515d-37bc-4c89-94e7-8742a6184776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2146848027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6def45-f4ae-4896-b6d7-1b4c310e1999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efab0234e0b84b40bf628fc1e70b4700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:39Z,use_quota=True,user_id='3244fa8988eb44149443e629f7bd0e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3addd36-49b0-4de8-8678-6e8b20238839),volume_type_id=c3addd36-49b0-4de8-8678-6e8b20238839)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a922ee1-cce5-4a46-9eae-c34f16c5aa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a922ee1-cce5-4a46-9eae-c34f16c5aa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3573eb31-45eb-4fb3-a90d-9482fa44bcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3573eb31-45eb-4fb3-a90d-9482fa44bcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6def45-f4ae-4896-b6d7-1b4c310e1999', 'volume_name': 'volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64ed031-7156-4660-92c5-b22b458ba057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64ed031-7156-4660-92c5-b22b458ba057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68240438-84d4-4304-92a2-2328e6662afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:39 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Volume bc6def45-f4ae-4896-b6d7-1b4c310e1999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999', 'volume_size': 1} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2146848027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6def45-f4ae-4896-b6d7-1b4c310e1999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efab0234e0b84b40bf628fc1e70b4700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:39Z,use_quota=True,user_id='3244fa8988eb44149443e629f7bd0e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3addd36-49b0-4de8-8678-6e8b20238839),volume_type_id=c3addd36-49b0-4de8-8678-6e8b20238839)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Creating volume bc6def45-f4ae-4896-b6d7-1b4c310e1999 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:39 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:39 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999 1073741824 Aug 01 15:06:39 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:40 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999 1073741824" returned: 0 in 0.707s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:40 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999 Aug 01 15:06:40 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Flow 'volume_create_manager' (3eeb46bf-0ed0-43fc-866a-3cf846d19602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb87ecef-d270-48d7-aeae-99da73201c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb87ecef-d270-48d7-aeae-99da73201c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1094092899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aef8e84-0234-41dd-8779-3484171d3825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d33c150d4774b939481ddc3fe198bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:40Z,use_quota=True,user_id='54a9b86aee12473183d088220b215de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33190dd7-366f-4829-8a7b-b98b3f540920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33190dd7-366f-4829-8a7b-b98b3f540920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e095efb7-bb69-433d-b867-0b10f6e4b535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e095efb7-bb69-433d-b867-0b10f6e4b535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aef8e84-0234-41dd-8779-3484171d3825', 'volume_name': 'volume-1aef8e84-0234-41dd-8779-3484171d3825', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6144f3c6-d3ed-4384-b336-c829373894bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6144f3c6-d3ed-4384-b336-c829373894bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc3589e-d879-4cf5-9793-b47220861f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:40 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Volume 1aef8e84-0234-41dd-8779-3484171d3825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aef8e84-0234-41dd-8779-3484171d3825', 'volume_size': 1} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Flow 'volume_create_manager' (2d326680-3127-4675-a53b-4177ec536193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f909d7-d28a-4b03-bf35-8aa161854ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f909d7-d28a-4b03-bf35-8aa161854ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-157170662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d334de2f-ba85-4898-8881-42b0d5c2e251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efab0234e0b84b40bf628fc1e70b4700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:40Z,use_quota=True,user_id='3244fa8988eb44149443e629f7bd0e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(016da553-b0a4-4203-8d06-8d5537bf13d3),volume_type_id=016da553-b0a4-4203-8d06-8d5537bf13d3)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ee8328-3e00-4c8d-8c59-f3072f287ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ee8328-3e00-4c8d-8c59-f3072f287ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e82f46-e73e-4d6f-8e45-dbf449d98f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e82f46-e73e-4d6f-8e45-dbf449d98f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd334de2f-ba85-4898-8881-42b0d5c2e251', 'volume_name': 'volume-d334de2f-ba85-4898-8881-42b0d5c2e251', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589051e6-7d46-4a97-9f4e-443e882cfd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589051e6-7d46-4a97-9f4e-443e882cfd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bb858a-a097-4bbd-ab16-f047d3ddd3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:40 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Volume d334de2f-ba85-4898-8881-42b0d5c2e251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d334de2f-ba85-4898-8881-42b0d5c2e251', 'volume_size': 1} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:40 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999" returned: 0 in 0.454s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1094092899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aef8e84-0234-41dd-8779-3484171d3825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d33c150d4774b939481ddc3fe198bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:40Z,use_quota=True,user_id='54a9b86aee12473183d088220b215de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Creating volume 1aef8e84-0234-41dd-8779-3484171d3825 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:40 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:40 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825 1073741824 Aug 01 15:06:40 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68240438-84d4-4304-92a2-2328e6662afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83053069-28d9-445d-90fd-423ba8671ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:41 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Volume volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999 (bc6def45-f4ae-4896-b6d7-1b4c310e1999): created successfully Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83053069-28d9-445d-90fd-423ba8671ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Flow 'volume_create_manager' (0d536dc5-27bb-4f2b-bddb-7395b6913040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Flow 'volume_create_manager' (7bd81047-6e68-4e45-a63e-677242ebb247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a60a7c-63a3-46a6-b0bd-b3c03e660a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a60a7c-63a3-46a6-b0bd-b3c03e660a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1179115945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8056a54d-6b2e-45ee-87b9-90d128a9ded2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efab0234e0b84b40bf628fc1e70b4700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:41Z,use_quota=True,user_id='3244fa8988eb44149443e629f7bd0e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7fd0bee-1e4f-4321-8ccd-e622dd9eaba8),volume_type_id=b7fd0bee-1e4f-4321-8ccd-e622dd9eaba8)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1014c7-572d-4112-9ec2-76a554016fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1014c7-572d-4112-9ec2-76a554016fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db7fee8-3148-4e37-92f3-e8aebdfa8807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:06:41 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d7d91bdb-c4d7-47e6-b92b-eb9d56af662f tempest-TestInstancesWithCinderVolumes-1175008379 None] Created volume successfully. Aug 01 15:06:41 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825 1073741824" returned: 0 in 0.653s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:41 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825 Aug 01 15:06:41 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db7fee8-3148-4e37-92f3-e8aebdfa8807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8056a54d-6b2e-45ee-87b9-90d128a9ded2', 'volume_name': 'volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2', 'volume_size': 1, 'image_id': '5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1362552661', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efab0234e0b84b40bf628fc1e70b4700', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'created_at': datetime.datetime(2026, 8, 1, 13, 6, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a295b23-4d76-442b-bbfe-bd5a58b016e8/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa43ed67-3a06-4a29-bc8c-0f3ad3a89687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa43ed67-3a06-4a29-bc8c-0f3ad3a89687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c154848-aaf1-417d-9076-78aeeebe64c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:41 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Volume 8056a54d-6b2e-45ee-87b9-90d128a9ded2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2', 'volume_size': 1, 'image_id': '5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1362552661', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efab0234e0b84b40bf628fc1e70b4700', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'created_at': datetime.datetime(2026, 8, 1, 13, 6, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a295b23-4d76-442b-bbfe-bd5a58b016e8/file', 'properties': {}}, 'image_service': } Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Trying to clone 8056a54d-6b2e-45ee-87b9-90d128a9ded2 from image 5a295b23-4d76-442b-bbfe-bd5a58b016e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:06:41 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825" returned: 0 in 0.371s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-157170662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d334de2f-ba85-4898-8881-42b0d5c2e251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efab0234e0b84b40bf628fc1e70b4700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:40Z,use_quota=True,user_id='3244fa8988eb44149443e629f7bd0e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(016da553-b0a4-4203-8d06-8d5537bf13d3),volume_type_id=016da553-b0a4-4203-8d06-8d5537bf13d3)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Creating volume d334de2f-ba85-4898-8881-42b0d5c2e251 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:41 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc3589e-d879-4cf5-9793-b47220861f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aef8e84-0234-41dd-8779-3484171d3825', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5524cc18-bbaf-4910-98a2-b610ed5b3aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:42 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251 1073741824 Aug 01 15:06:42 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:42 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Volume volume-1aef8e84-0234-41dd-8779-3484171d3825 (1aef8e84-0234-41dd-8779-3484171d3825): created successfully Aug 01 15:06:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5524cc18-bbaf-4910-98a2-b610ed5b3aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Flow 'volume_create_manager' (3eeb46bf-0ed0-43fc-866a-3cf846d19602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4fa0dd66-7a48-4f1d-9322-a726c6d24b4e tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Created volume successfully. Aug 01 15:06:42 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251 1073741824" returned: 0 in 0.602s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:42 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251 Aug 01 15:06:42 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:42 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251" returned: 0 in 0.319s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bb858a-a097-4bbd-ab16-f047d3ddd3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d334de2f-ba85-4898-8881-42b0d5c2e251', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb610745-de7d-4500-8af2-ef67e8e949ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:43 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Volume volume-d334de2f-ba85-4898-8881-42b0d5c2e251 (d334de2f-ba85-4898-8881-42b0d5c2e251): created successfully Aug 01 15:06:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb610745-de7d-4500-8af2-ef67e8e949ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Flow 'volume_create_manager' (2d326680-3127-4675-a53b-4177ec536193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ff3dc217-7bd6-401f-93cb-e594351362b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Created volume successfully. Aug 01 15:06:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Acquiring lock "cinder-1aef8e84-0234-41dd-8779-3484171d3825-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Lock "cinder-1aef8e84-0234-41dd-8779-3484171d3825-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Acquiring lock "cinder-quobyte-1aef8e84-0234-41dd-8779-3484171d3825" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Lock "cinder-quobyte-1aef8e84-0234-41dd-8779-3484171d3825" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:44 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ec8897-60b0-4851-9b0a-2942f70aab40]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:44 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825 Aug 01 15:06:44 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:44 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825" returned: 0 in 0.421s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:44 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825 Aug 01 15:06:44 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:45 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1aef8e84-0234-41dd-8779-3484171d3825" returned: 0 in 0.278s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Lock "cinder-quobyte-1aef8e84-0234-41dd-8779-3484171d3825" released by "delete_volume" :: held 0.743s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Created reservations ['22fe1b15-280b-4859-a862-c506d80dc2b5', '5de52ae5-3ebb-4826-b550-ec5b2207ad51', '21f964ba-983a-4ba6-86a0-54651bf54501', '834171ab-61b2-4fe9-bdd8-5d23c178b814'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:45 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:06:45 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:45 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.276s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:06:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Deleted volume successfully. Aug 01 15:06:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-da7e3c50-e028-4b2f-a846-96df0bc85b42 tempest-VolumeQuotasNegativeTestJSON-1312343090 None] Lock "cinder-1aef8e84-0234-41dd-8779-3484171d3825-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Flow 'volume_create_manager' (983e1e43-6a60-4ea2-b8ba-c2a5cbb20702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae16b00-f2bb-47e9-a4fc-b11e841fbfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae16b00-f2bb-47e9-a4fc-b11e841fbfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-681624742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec02c86-2a23-4274-9c25-c918765250f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4253f2b537e4464aa95d5cb58f308194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:46Z,use_quota=True,user_id='ee1f54c3b77a49698cc416eef65e330e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772bb274-52f4-4688-8d9d-e464d85328ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772bb274-52f4-4688-8d9d-e464d85328ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8710f6-3011-444a-aa5d-5d8aea6aa723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8710f6-3011-444a-aa5d-5d8aea6aa723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec02c86-2a23-4274-9c25-c918765250f2', 'volume_name': 'volume-3ec02c86-2a23-4274-9c25-c918765250f2', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee8efc6-3e09-42ff-9f96-ceb4ca94b716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bee8efc6-3e09-42ff-9f96-ceb4ca94b716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54584ef1-9253-4f90-938e-f31b81f1e6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Volume 3ec02c86-2a23-4274-9c25-c918765250f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec02c86-2a23-4274-9c25-c918765250f2', 'volume_size': 1} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-681624742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec02c86-2a23-4274-9c25-c918765250f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4253f2b537e4464aa95d5cb58f308194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:46Z,use_quota=True,user_id='ee1f54c3b77a49698cc416eef65e330e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Creating volume 3ec02c86-2a23-4274-9c25-c918765250f2 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:46 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:46 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 1073741824 Aug 01 15:06:46 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD, size 20.69 MB, duration 4.48 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:06:46 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Image download 20.69 MB at 4.62 MB/s Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dc0002-a7f2-4929-9ee5-19ae84eb2f5c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:46 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD Aug 01 15:06:46 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:46 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 1073741824" returned: 0 in 0.470s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:46 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Temporary image 5a295b23-4d76-442b-bbfe-bd5a58b016e8 is fetched for user 3244fa8988eb44149443e629f7bd0e67. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:06:46 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 Aug 01 15:06:46 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ae5618-6669-4c1e-ba3b-57f7f08861f1]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:47 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD Aug 01 15:06:47 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:47 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2" returned: 0 in 0.317s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54584ef1-9253-4f90-938e-f31b81f1e6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec02c86-2a23-4274-9c25-c918765250f2', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab6b756-7b62-4f1f-904a-6d7cf3f74ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Volume volume-3ec02c86-2a23-4274-9c25-c918765250f2 (3ec02c86-2a23-4274-9c25-c918765250f2): created successfully Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab6b756-7b62-4f1f-904a-6d7cf3f74ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Flow 'volume_create_manager' (983e1e43-6a60-4ea2-b8ba-c2a5cbb20702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f08889be-20c2-4b73-914a-122fe5d1f671 tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Created volume successfully. Aug 01 15:06:47 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1179115945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8056a54d-6b2e-45ee-87b9-90d128a9ded2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efab0234e0b84b40bf628fc1e70b4700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:41Z,use_quota=True,user_id='3244fa8988eb44149443e629f7bd0e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7fd0bee-1e4f-4321-8ccd-e622dd9eaba8),volume_type_id=b7fd0bee-1e4f-4321-8ccd-e622dd9eaba8)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Creating volume 8056a54d-6b2e-45ee-87b9-90d128a9ded2 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:47 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:47 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 1073741824 Aug 01 15:06:47 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:47 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 1073741824" returned: 0 in 0.450s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:47 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 Aug 01 15:06:47 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:48 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2" returned: 0 in 0.266s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Attempting download of 5a295b23-4d76-442b-bbfe-bd5a58b016e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'metadata': {}}])) to volume 8056a54d-6b2e-45ee-87b9-90d128a9ded2. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef221a56-0eef-45ac-8139-501b08a62c92]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a295b23-4d76-442b-bbfe-bd5a58b016e8_y8hspej4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:48 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a295b23-4d76-442b-bbfe-bd5a58b016e8_y8hspej4 Aug 01 15:06:48 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Creating offline snapshot e96224fd-e24e-418a-ab86-deaa0b780cc0 of volume 3ec02c86-2a23-4274-9c25-c918765250f2 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bef29a-5344-4ece-bfe0-b892458bf1a4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:48 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a295b23-4d76-442b-bbfe-bd5a58b016e8_y8hspej4" returned: 0 in 0.463s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a295b23-4d76-442b-bbfe-bd5a58b016e8_y8hspej4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:48 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 Aug 01 15:06:48 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:48 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a295b23-4d76-442b-bbfe-bd5a58b016e8_y8hspej4 Aug 01 15:06:48 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:48 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2" returned: 0 in 0.424s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:48 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 1G Aug 01 15:06:48 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:48 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a295b23-4d76-442b-bbfe-bd5a58b016e8_y8hspej4" returned: 1 in 0.365s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a295b23-4d76-442b-bbfe-bd5a58b016e8_y8hspej4' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94d5e03-b841-4549-9959-0b476cb284c7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:49 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD Aug 01 15:06:49 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:49 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:49 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] 5a295b23-4d76-442b-bbfe-bd5a58b016e8 was qcow2, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:06:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:49 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 Aug 01 15:06:49 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:49 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 1G" returned: 0 in 0.555s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec02c86-2a23-4274-9c25-c918765250f2 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:49 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec02c86-2a23-4274-9c25-c918765250f2 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 Aug 01 15:06:49 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:49 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec02c86-2a23-4274-9c25-c918765250f2 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0" returned: 0 in 0.369s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:49 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 is being set with open permissions: ugo+rw Aug 01 15:06:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:49 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 Aug 01 15:06:49 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:50 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0" returned: 0 in 0.291s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:50 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.info Aug 01 15:06:50 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:50 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.info" returned: 0 in 0.307s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:50 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.info is being set with open permissions: ugo+rw Aug 01 15:06:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:50 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.info Aug 01 15:06:50 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:50 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.info" returned: 0 in 0.393s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-87157ebf-eeab-4761-949c-89eb9c960d4b tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Create snapshot completed successfully Aug 01 15:06:51 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2" returned: 0 in 2.149s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a295b23-4d76-442b-bbfe-bd5a58b016e8_sca5_fmidevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:06:51 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Converted 112.00 MB image at 52.07 MB/s Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:51 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 1G Aug 01 15:06:51 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Flow 'volume_create_manager' (d9498493-15ac-435d-b270-01a79f83ad3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7b6629-9d5f-41e3-af64-d17ed31a98d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7b6629-9d5f-41e3-af64-d17ed31a98d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1641178858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058ed6ba-f71f-43ec-be9d-ddf1217748d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6922f11c8a4c7090fa43bae80196f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:52Z,use_quota=True,user_id='af316152d42b46fabce333632eb5e3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0887f25f-64a7-40db-97f7-4fdd2d006598),volume_type_id=0887f25f-64a7-40db-97f7-4fdd2d006598)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae49017-ec0a-4a31-bf45-da9aef4bf26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae49017-ec0a-4a31-bf45-da9aef4bf26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d8c284-4f52-47db-91ec-f4c7a637fb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d8c284-4f52-47db-91ec-f4c7a637fb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '058ed6ba-f71f-43ec-be9d-ddf1217748d3', 'volume_name': 'volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7955023-e6ab-4592-b0e3-f9c4f2f6fec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7955023-e6ab-4592-b0e3-f9c4f2f6fec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa1df53-7301-45ab-be4f-c65703159358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:51 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Volume 058ed6ba-f71f-43ec-be9d-ddf1217748d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3', 'volume_size': 1} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1641178858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058ed6ba-f71f-43ec-be9d-ddf1217748d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6922f11c8a4c7090fa43bae80196f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:52Z,use_quota=True,user_id='af316152d42b46fabce333632eb5e3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0887f25f-64a7-40db-97f7-4fdd2d006598),volume_type_id=0887f25f-64a7-40db-97f7-4fdd2d006598)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Creating volume 058ed6ba-f71f-43ec-be9d-ddf1217748d3 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:51 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:51 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3 1073741824 Aug 01 15:06:51 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:51 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 1G" returned: 0 in 0.462s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Downloaded image 5a295b23-4d76-442b-bbfe-bd5a58b016e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'metadata': {}}])) to volume 8056a54d-6b2e-45ee-87b9-90d128a9ded2 successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Temporary image 5a295b23-4d76-442b-bbfe-bd5a58b016e8 for user 3244fa8988eb44149443e629f7bd0e67 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:06:51 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Marking volume 8056a54d-6b2e-45ee-87b9-90d128a9ded2 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Copying metadata from image 5a295b23-4d76-442b-bbfe-bd5a58b016e8 to 8056a54d-6b2e-45ee-87b9-90d128a9ded2. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Creating volume glance metadata for volume 8056a54d-6b2e-45ee-87b9-90d128a9ded2 backed by image 5a295b23-4d76-442b-bbfe-bd5a58b016e8 with: {'image_id': '5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'image_name': 'tempest-scenario-img--1362552661', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c154848-aaf1-417d-9076-78aeeebe64c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2', 'volume_size': 1, 'image_id': '5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1362552661', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'efab0234e0b84b40bf628fc1e70b4700', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5a295b23-4d76-442b-bbfe-bd5a58b016e8', 'created_at': datetime.datetime(2026, 8, 1, 13, 6, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 6, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a295b23-4d76-442b-bbfe-bd5a58b016e8/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a0de36-1644-4771-a786-49888f91a8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Volume volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 (8056a54d-6b2e-45ee-87b9-90d128a9ded2): created successfully Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a0de36-1644-4771-a786-49888f91a8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Flow 'volume_create_manager' (7bd81047-6e68-4e45-a63e-677242ebb247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1b1768f5-19b5-47ad-9d30-97af80273d73 tempest-TestInstancesWithCinderVolumes-1175008379 None] Created volume successfully. Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Acquiring lock "cinder-e96224fd-e24e-418a-ab86-deaa0b780cc0-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "cinder-e96224fd-e24e-418a-ab86-deaa0b780cc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Acquiring lock "cinder-quobyte-3ec02c86-2a23-4274-9c25-c918765250f2" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "cinder-quobyte-3ec02c86-2a23-4274-9c25-c918765250f2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Acquiring lock "cinder-quobyte-e96224fd-e24e-418a-ab86-deaa0b780cc0" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "cinder-quobyte-e96224fd-e24e-418a-ab86-deaa0b780cc0" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Deleting offline snapshot e96224fd-e24e-418a-ab86-deaa0b780cc0 of volume 3ec02c86-2a23-4274-9c25-c918765250f2 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] snapshot_file for this snap is: volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf2fbff-aec5-4c31-8ed0-890f447dd0cc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:52 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3 1073741824" returned: 0 in 0.575s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:52 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3 Aug 01 15:06:52 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:52 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 Aug 01 15:06:52 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:52 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3" returned: 0 in 0.254s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa1df53-7301-45ab-be4f-c65703159358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758fe008-f2c2-4756-9e24-1976f1bdcf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Volume volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3 (058ed6ba-f71f-43ec-be9d-ddf1217748d3): created successfully Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758fe008-f2c2-4756-9e24-1976f1bdcf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Flow 'volume_create_manager' (d9498493-15ac-435d-b270-01a79f83ad3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:52 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-eab01f43-df0e-4d44-b85c-73f8a51b9626 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Created volume successfully. Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0" returned: 0 in 0.389s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ec02c86-2a23-4274-9c25-c918765250f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bea3476-074e-4888-8d09-98188c320cdd]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:52 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 Aug 01 15:06:52 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:53 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2" returned: 0 in 0.396s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:53 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 Aug 01 15:06:53 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:53 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0" returned: 0 in 0.344s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:53 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0 Aug 01 15:06:53 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:53 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2.e96224fd-e24e-418a-ab86-deaa0b780cc0" returned: 0 in 0.262s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "cinder-quobyte-e96224fd-e24e-418a-ab86-deaa0b780cc0" released by "_delete_snapshot" :: held 1.517s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "cinder-quobyte-3ec02c86-2a23-4274-9c25-c918765250f2" released by "delete_snapshot" :: held 1.555s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:53 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Created reservations ['d39835cb-eee0-40ba-8634-7d8d4aeba8f9', 'b5df79d3-ceac-4ced-b5e9-4be543a87a3e', '6b77f7f5-e595-4f6e-a6d5-a07a7cab381e', 'af61b3b7-972e-49f3-a908-168ab7e02ca6'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:06:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Delete snapshot completed successfully. Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-55ff6e1b-a2f2-4081-b608-4e52658c059d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "cinder-e96224fd-e24e-418a-ab86-deaa0b780cc0-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a7f30f5e-37fa-4426-9aea-6a0f0c039ae4 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a7f30f5e-37fa-4426-9aea-6a0f0c039ae4 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a7f30f5e-37fa-4426-9aea-6a0f0c039ae4 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a7f30f5e-37fa-4426-9aea-6a0f0c039ae4 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a7f30f5e-37fa-4426-9aea-6a0f0c039ae4 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a7f30f5e-37fa-4426-9aea-6a0f0c039ae4 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:54 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:06:54 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Acquiring lock "cinder-3ec02c86-2a23-4274-9c25-c918765250f2-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "cinder-3ec02c86-2a23-4274-9c25-c918765250f2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:54 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a7f30f5e-37fa-4426-9aea-6a0f0c039ae4 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-a7f30f5e-37fa-4426-9aea-6a0f0c039ae4 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:06:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a7f30f5e-37fa-4426-9aea-6a0f0c039ae4 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Retype volume completed successfully. Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Acquiring lock "cinder-quobyte-3ec02c86-2a23-4274-9c25-c918765250f2" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "cinder-quobyte-3ec02c86-2a23-4274-9c25-c918765250f2" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8e83e8-1548-4d1a-a118-f623d8afc8a7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:54 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 Aug 01 15:06:54 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:55 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2" returned: 0 in 0.403s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:55 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2 Aug 01 15:06:55 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:55 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3ec02c86-2a23-4274-9c25-c918765250f2" returned: 0 in 0.423s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "cinder-quobyte-3ec02c86-2a23-4274-9c25-c918765250f2" released by "delete_volume" :: held 0.889s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Created reservations ['e8c87ae1-8640-493c-97c2-93ccc70a8f50', '1909db8e-fe7d-45ba-b4b2-e5ac7b1a4e20', 'c3ebbd1b-c3f9-475f-b311-8a6e46d09c10', 'f4e48bcb-2a1f-45c8-b476-5c71d10a25e3'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Acquiring lock "cinder-058ed6ba-f71f-43ec-be9d-ddf1217748d3-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "cinder-058ed6ba-f71f-43ec-be9d-ddf1217748d3-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:55 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:06:55 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-76e15820-97b6-4ed1-baf2-dceb19fa4c2d req-3d720a6e-38f1-480a-b1eb-5176566f9446 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-76e15820-97b6-4ed1-baf2-dceb19fa4c2d req-3d720a6e-38f1-480a-b1eb-5176566f9446 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-76e15820-97b6-4ed1-baf2-dceb19fa4c2d req-3d720a6e-38f1-480a-b1eb-5176566f9446 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Acquiring lock "cinder-quobyte-058ed6ba-f71f-43ec-be9d-ddf1217748d3" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "cinder-quobyte-058ed6ba-f71f-43ec-be9d-ddf1217748d3" acquired by "delete_volume" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-76e15820-97b6-4ed1-baf2-dceb19fa4c2d req-3d720a6e-38f1-480a-b1eb-5176566f9446 tempest-TestInstancesWithCinderVolumes-1175008379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b261222a-61a5-4412-889a-4e27ec1eb2d6', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06607e7-6e72-461a-8082-3a3218820396]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:06:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-76e15820-97b6-4ed1-baf2-dceb19fa4c2d req-3d720a6e-38f1-480a-b1eb-5176566f9446 tempest-TestInstancesWithCinderVolumes-1175008379 None] attachment_update completed successfully. Aug 01 15:06:56 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3 Aug 01 15:06:56 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:56 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.582s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:56 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:06:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Deleted volume successfully. Aug 01 15:06:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5084d3f9-523c-425b-9e40-e864dfbb401d tempest-VolumeSnapshotQuotasNegativeTestJSON-1755797979 None] Lock "cinder-3ec02c86-2a23-4274-9c25-c918765250f2-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:56 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3" returned: 0 in 0.590s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:56 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3 Aug 01 15:06:56 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:56 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-058ed6ba-f71f-43ec-be9d-ddf1217748d3" returned: 0 in 0.386s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "cinder-quobyte-058ed6ba-f71f-43ec-be9d-ddf1217748d3" released by "delete_volume" :: held 1.059s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:56 devstack cinder-volume[89024]: WARNING cinder.quota [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:06:56 devstack cinder-volume[89024]: WARNING cinder.quota [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:06:56 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Created reservations ['6a9937c5-559b-46ee-9756-0e8f32cc5221', '63b7cd1e-bedd-42da-b364-cc2b68c8c5b7', 'd7033ec7-88d0-4e3c-94dd-c8997b2034bf', 'b56be70a-9448-4d4c-8daa-940465e63457'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:57 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:06:57 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Flow 'volume_create_manager' (a081e153-2217-4753-b45f-f33f9acc5ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637eaf91-1b03-4524-81db-0ed739570805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637eaf91-1b03-4524-81db-0ed739570805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1697520786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f093ba58-1623-4623-ac50-13d1333c5250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b6d8809acc4ee58046f437a40e937c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:57Z,use_quota=True,user_id='ff39e3419dab41bd8d3e1f7a19abfba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3616f2-fee6-446e-9b2b-6093baf8f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3616f2-fee6-446e-9b2b-6093baf8f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67019d12-4d53-41cd-8319-6db9eb7e79b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67019d12-4d53-41cd-8319-6db9eb7e79b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f093ba58-1623-4623-ac50-13d1333c5250', 'volume_name': 'volume-f093ba58-1623-4623-ac50-13d1333c5250', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a67616-cbb2-48fc-95d7-ba326d91eeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a67616-cbb2-48fc-95d7-ba326d91eeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78585de3-6ef4-4163-b110-0e3ddf185f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:57 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Volume f093ba58-1623-4623-ac50-13d1333c5250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f093ba58-1623-4623-ac50-13d1333c5250', 'volume_size': 1} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1697520786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f093ba58-1623-4623-ac50-13d1333c5250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b6d8809acc4ee58046f437a40e937c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:06:57Z,use_quota=True,user_id='ff39e3419dab41bd8d3e1f7a19abfba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Creating volume f093ba58-1623-4623-ac50-13d1333c5250 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:06:57 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:57 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250 1073741824 Aug 01 15:06:57 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:57 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.326s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:06:57 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Deleted volume successfully. Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9cce3680-b9fe-4d42-8b1f-b52b39fa6a63 tempest-VolumeRetypeWithoutMigrationTest-1414450510 None] Lock "cinder-058ed6ba-f71f-43ec-be9d-ddf1217748d3-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:06:57 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250 1073741824" returned: 0 in 0.532s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:06:57 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250 Aug 01 15:06:57 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:06:58 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Aug 01 15:06:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250" returned: 0 in 0.445s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:06:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:06:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:06:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78585de3-6ef4-4163-b110-0e3ddf185f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f093ba58-1623-4623-ac50-13d1333c5250', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31b431b-2900-44e3-8c38-cd1ce94be827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:06:58 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Volume volume-f093ba58-1623-4623-ac50-13d1333c5250 (f093ba58-1623-4623-ac50-13d1333c5250): created successfully Aug 01 15:06:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31b431b-2900-44e3-8c38-cd1ce94be827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:06:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Flow 'volume_create_manager' (a081e153-2217-4753-b45f-f33f9acc5ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:06:58 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1aa07e4a-8db9-451c-a656-84dd648fb39a tempest-AttachVolumeNegativeTest-1581032568 None] Created volume successfully. Aug 01 15:07:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1bc70a01-780b-402b-9f53-d3464bd8c08c req-01eff1eb-266a-4d64-a5f7-67287f51776b tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1bc70a01-780b-402b-9f53-d3464bd8c08c req-01eff1eb-266a-4d64-a5f7-67287f51776b tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1bc70a01-780b-402b-9f53-d3464bd8c08c req-01eff1eb-266a-4d64-a5f7-67287f51776b tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-1bc70a01-780b-402b-9f53-d3464bd8c08c req-01eff1eb-266a-4d64-a5f7-67287f51776b tempest-AttachVolumeNegativeTest-1581032568 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-f093ba58-1623-4623-ac50-13d1333c5250', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a61c5ca-d0d2-46f7-b533-b79df57e3954', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:07:01 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-1bc70a01-780b-402b-9f53-d3464bd8c08c req-01eff1eb-266a-4d64-a5f7-67287f51776b tempest-AttachVolumeNegativeTest-1581032568 None] attachment_update completed successfully. Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Flow 'volume_create_manager' (f1635f2a-55a5-4dd9-a6aa-3aa88205595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a4ce5a-b56c-4778-a11d-1feda4babd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a4ce5a-b56c-4778-a11d-1feda4babd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-661504841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb9450fd1f84fa8a766d7efdc4e115e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:04Z,use_quota=True,user_id='6d13c958ab054916a3240138faf34905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d50ec2-5b9c-4b91-9051-e6f6a377d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d50ec2-5b9c-4b91-9051-e6f6a377d09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a64ca2e-9120-4dba-8742-06ba19c4ba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a64ca2e-9120-4dba-8742-06ba19c4ba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1', 'volume_name': 'volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995283cf-1c6a-4eca-b555-421554580e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995283cf-1c6a-4eca-b555-421554580e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d302a6df-154f-4a17-affa-e97d16ec1d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Volume 90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1', 'volume_size': 1} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-661504841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb9450fd1f84fa8a766d7efdc4e115e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:04Z,use_quota=True,user_id='6d13c958ab054916a3240138faf34905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Creating volume 90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:07:03 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:07:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:04 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 1073741824 Aug 01 15:07:04 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:05 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 1073741824" returned: 0 in 1.017s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:05 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 Aug 01 15:07:05 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:05 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1" returned: 0 in 0.449s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:07:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d302a6df-154f-4a17-affa-e97d16ec1d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0655dc6b-e8c4-4ea1-904e-551bed6c9699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:05 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Volume volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 (90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1): created successfully Aug 01 15:07:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0655dc6b-e8c4-4ea1-904e-551bed6c9699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Flow 'volume_create_manager' (f1635f2a-55a5-4dd9-a6aa-3aa88205595d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:05 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-953e7578-b32b-48da-9252-9310bc3817c2 tempest-SnapshotMetadataTestJSON-596343612 None] Created volume successfully. Aug 01 15:07:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] Creating offline snapshot d0aa2ef2-3517-4cff-a8bf-df82272be30a of volume 90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:07:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1635d56-009f-4166-8cd1-8cf8323e1d19]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:06 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 Aug 01 15:07:06 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:07 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1" returned: 0 in 0.737s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:07 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a 1G Aug 01 15:07:07 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:08 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a 1G" returned: 0 in 0.885s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:08 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a Aug 01 15:07:08 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:08 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a" returned: 0 in 0.587s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:08 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a is being set with open permissions: ugo+rw Aug 01 15:07:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:08 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a Aug 01 15:07:08 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:09 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a" returned: 0 in 0.922s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:09 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.info Aug 01 15:07:09 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:10 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.info" returned: 0 in 0.517s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:10 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.info is being set with open permissions: ugo+rw Aug 01 15:07:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:10 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.info Aug 01 15:07:10 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:10 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.info" returned: 0 in 0.417s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.298s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-32f6986d-8acf-4e1f-9c69-484b26767a1d tempest-SnapshotMetadataTestJSON-596343612 None] Create snapshot completed successfully Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Acquiring lock "cinder-d0aa2ef2-3517-4cff-a8bf-df82272be30a-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Lock "cinder-d0aa2ef2-3517-4cff-a8bf-df82272be30a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Acquiring lock "cinder-quobyte-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Lock "cinder-quobyte-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1" acquired by "delete_snapshot" :: waited 0.044s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Acquiring lock "cinder-quobyte-d0aa2ef2-3517-4cff-a8bf-df82272be30a" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Lock "cinder-quobyte-d0aa2ef2-3517-4cff-a8bf-df82272be30a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Deleting offline snapshot d0aa2ef2-3517-4cff-a8bf-df82272be30a of volume 90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] snapshot_file for this snap is: volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e30755-3fde-4809-aac6-8ace86862a0f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:13 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a Aug 01 15:07:13 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:13 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a" returned: 0 in 0.459s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ffffc1-f1d3-4545-8af9-7b8a823fbefb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:14 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 Aug 01 15:07:14 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:14 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1" returned: 0 in 0.540s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:14 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a Aug 01 15:07:14 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:15 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a" returned: 0 in 0.747s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:15 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a Aug 01 15:07:15 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:15 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1.d0aa2ef2-3517-4cff-a8bf-df82272be30a" returned: 0 in 0.346s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Lock "cinder-quobyte-d0aa2ef2-3517-4cff-a8bf-df82272be30a" released by "_delete_snapshot" :: held 2.287s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Lock "cinder-quobyte-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1" released by "delete_snapshot" :: held 2.322s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:15 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Created reservations ['05d3ffde-e8c8-40e7-8dad-353b6a278857', 'd5fc7bea-d5ca-45b5-952d-f1ee51b34dd7', 'fcc78fad-3fbd-424d-9d24-606a9dde5a98', 'a8a7e65b-bd33-4c6c-8ab9-10a2edaa5920'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:07:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Delete snapshot completed successfully. Aug 01 15:07:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2883768c-e202-4d33-9945-82e2947fccee tempest-SnapshotMetadataTestJSON-596343612 None] Lock "cinder-d0aa2ef2-3517-4cff-a8bf-df82272be30a-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Acquiring lock "cinder-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Lock "cinder-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Acquiring lock "cinder-quobyte-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Lock "cinder-quobyte-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1" acquired by "delete_volume" :: waited 0.048s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:17 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4e2690-72c0-4cef-8671-5e8f398523fc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:17 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 Aug 01 15:07:17 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:18 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1" returned: 0 in 1.046s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:18 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1 Aug 01 15:07:18 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:18 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:07:18 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:18 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1" returned: 0 in 0.409s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Lock "cinder-quobyte-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1" released by "delete_volume" :: held 1.637s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:18 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Created reservations ['04003efa-01d0-4119-bac6-a6048725ab63', 'e01e204f-15e6-42a7-9ecd-25f527817fcf', 'dc285aa1-9601-4828-b49f-294700fa8491', '5af61e97-19ae-4313-91f1-896f3ed172f9'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:07:19 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.461s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:19 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:07:19 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:19 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.398s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:07:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Deleted volume successfully. Aug 01 15:07:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45607526-61b6-4670-b619-96b09bc26ec7 tempest-SnapshotMetadataTestJSON-596343612 None] Lock "cinder-90bf9c31-2ceb-4ea2-bea1-e4e557fc73e1-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Flow 'volume_create_manager' (6a2dc847-3c19-4f2c-8ea8-c3d55817df47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad4284c-40af-4904-8127-95008197e4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ad4284c-40af-4904-8127-95008197e4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1769544158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba257e0-fb70-482c-978b-b923a83e3a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38effeeeca31412aab14d7e229df7646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:27Z,use_quota=True,user_id='119aee3bc8444587b4fefacfee390f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95c158b-a561-465d-a832-dbc7ea3fbda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95c158b-a561-465d-a832-dbc7ea3fbda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235433ec-711b-4acc-9958-5d86463b709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235433ec-711b-4acc-9958-5d86463b709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba257e0-fb70-482c-978b-b923a83e3a19', 'volume_name': 'volume-bba257e0-fb70-482c-978b-b923a83e3a19', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb45fce4-2688-4784-9176-06dbf45a7a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb45fce4-2688-4784-9176-06dbf45a7a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bedd8afa-d021-4ae9-ae12-9943342b8433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:27 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Volume bba257e0-fb70-482c-978b-b923a83e3a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba257e0-fb70-482c-978b-b923a83e3a19', 'volume_size': 1} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1769544158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba257e0-fb70-482c-978b-b923a83e3a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38effeeeca31412aab14d7e229df7646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:27Z,use_quota=True,user_id='119aee3bc8444587b4fefacfee390f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Creating volume bba257e0-fb70-482c-978b-b923a83e3a19 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:07:27 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:27 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19 1073741824 Aug 01 15:07:27 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:27 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19 1073741824" returned: 0 in 0.477s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:27 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19 Aug 01 15:07:27 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Flow 'volume_create_manager' (ab6e26d1-2f81-42a6-8ba0-bf54e6e6e548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3818e163-0682-41b9-a4e6-cb4559eb3916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3818e163-0682-41b9-a4e6-cb4559eb3916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1911000196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c159167d-a6dd-494b-b8ad-5a5535eb775c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe4f069b8284e2787c438c242c3bb0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:28Z,use_quota=True,user_id='30bf6550b8da48719d42a0bc5f4402fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b48173a-d5b6-4c55-840b-46c14291e798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b48173a-d5b6-4c55-840b-46c14291e798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817b31a4-55fc-4f8b-b592-3b1cf8258c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:27 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:07:28 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19" returned: 0 in 0.304s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bedd8afa-d021-4ae9-ae12-9943342b8433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba257e0-fb70-482c-978b-b923a83e3a19', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641efe77-e454-485c-92d7-f774442a40ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:28 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Volume volume-bba257e0-fb70-482c-978b-b923a83e3a19 (bba257e0-fb70-482c-978b-b923a83e3a19): created successfully Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641efe77-e454-485c-92d7-f774442a40ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Flow 'volume_create_manager' (6a2dc847-3c19-4f2c-8ea8-c3d55817df47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:28 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8c6194fa-9b76-47d3-87b7-01f866046152 tempest-AbsoluteLimitsTests-1712892723 None] Created volume successfully. Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817b31a4-55fc-4f8b-b592-3b1cf8258c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c159167d-a6dd-494b-b8ad-5a5535eb775c', 'volume_name': 'volume-c159167d-a6dd-494b-b8ad-5a5535eb775c', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40ca114-16e0-4e86-9704-e9aa84ee13ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40ca114-16e0-4e86-9704-e9aa84ee13ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be04e09-88d5-4768-8586-4185ce3efbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:28 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Volume c159167d-a6dd-494b-b8ad-5a5535eb775c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c159167d-a6dd-494b-b8ad-5a5535eb775c', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Trying to clone c159167d-a6dd-494b-b8ad-5a5535eb775c from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:07:28 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Image download 20.69 MB at 20.69 MB/s Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddc8c42-3989-4b42-ab31-d83b2bc373a2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:28 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD Aug 01 15:07:28 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:28 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:28 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf is fetched for user 30bf6550b8da48719d42a0bc5f4402fb. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[812461d6-d8c0-4655-ad76-7b8a2d66a140]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:29 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD Aug 01 15:07:29 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Acquiring lock "cinder-bba257e0-fb70-482c-978b-b923a83e3a19-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Lock "cinder-bba257e0-fb70-482c-978b-b923a83e3a19-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:29 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1911000196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c159167d-a6dd-494b-b8ad-5a5535eb775c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe4f069b8284e2787c438c242c3bb0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:28Z,use_quota=True,user_id='30bf6550b8da48719d42a0bc5f4402fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Creating volume c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:07:29 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Acquiring lock "cinder-quobyte-bba257e0-fb70-482c-978b-b923a83e3a19" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:29 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c 1073741824 Aug 01 15:07:29 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Lock "cinder-quobyte-bba257e0-fb70-482c-978b-b923a83e3a19" acquired by "delete_volume" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc03de3-ab05-4263-b001-03f447cfe830]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:29 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19 Aug 01 15:07:29 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:30 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c 1073741824" returned: 0 in 0.600s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:30 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19" returned: 0 in 0.564s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:30 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c Aug 01 15:07:30 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:30 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19 Aug 01 15:07:30 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:30 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c" returned: 0 in 0.294s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:30 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bba257e0-fb70-482c-978b-b923a83e3a19" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Lock "cinder-quobyte-bba257e0-fb70-482c-978b-b923a83e3a19" released by "delete_volume" :: held 0.905s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Attempting download of a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume c159167d-a6dd-494b-b8ad-5a5535eb775c. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Created reservations ['5242fd98-c94a-4108-a010-1c71024e42cc', '176fba95-5911-40e1-9e09-f5e377c661f7', '37a57bba-3524-475d-8b9c-cff8f4ca668e', '038bc087-3579-4c22-aec5-57a4fab26513'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b153d2c9-0f79-44c9-ba06-40dd03d1e832]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_q1nqinjc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:30 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:07:30 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:30 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_q1nqinjc Aug 01 15:07:30 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:31 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.361s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:31 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_q1nqinjc" returned: 0 in 0.479s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_q1nqinjc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:31 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Deleted volume successfully. Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db9cb491-6e03-47ad-9f16-10b05f2a0b15 tempest-AbsoluteLimitsTests-1712892723 None] Lock "cinder-bba257e0-fb70-482c-978b-b923a83e3a19-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:31 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_q1nqinjc Aug 01 15:07:31 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:31 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_q1nqinjc" returned: 1 in 0.356s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_q1nqinjc' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5c3e43-3066-4040-a68c-c54590ed76cc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:31 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD Aug 01 15:07:31 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:31 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf was qcow2, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:07:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:31 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c Aug 01 15:07:31 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:33 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c" returned: 0 in 2.084s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:33 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_f4kf24z8devstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:07:33 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Converted 112.00 MB image at 53.71 MB/s Aug 01 15:07:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:33 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c 1G Aug 01 15:07:33 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:34 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c 1G" returned: 0 in 0.351s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:34 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Downloaded image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume c159167d-a6dd-494b-b8ad-5a5535eb775c successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:07:34 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf for user 30bf6550b8da48719d42a0bc5f4402fb is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:07:34 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Marking volume c159167d-a6dd-494b-b8ad-5a5535eb775c as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:07:34 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Copying metadata from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf to c159167d-a6dd-494b-b8ad-5a5535eb775c. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:07:34 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Creating volume glance metadata for volume c159167d-a6dd-494b-b8ad-5a5535eb775c backed by image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:07:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be04e09-88d5-4768-8586-4185ce3efbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c159167d-a6dd-494b-b8ad-5a5535eb775c', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2969c0f-d267-4cf4-9abf-ad85c1255dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:34 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Volume volume-c159167d-a6dd-494b-b8ad-5a5535eb775c (c159167d-a6dd-494b-b8ad-5a5535eb775c): created successfully Aug 01 15:07:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2969c0f-d267-4cf4-9abf-ad85c1255dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Flow 'volume_create_manager' (ab6e26d1-2f81-42a6-8ba0-bf54e6e6e548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:34 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0404b38c-34ac-412b-a376-7a5552042ef9 tempest-VolumesCloneTest-749649770 None] Created volume successfully. Aug 01 15:07:35 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:07:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Flow 'volume_create_manager' (ed801590-7a03-432d-a75f-648cf471d437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2795c1b4-8eb0-4436-8ee5-a459811a2748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2795c1b4-8eb0-4436-8ee5-a459811a2748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1734425436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daadd69d-5ac9-4d2f-af07-c84711ed0d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe4f069b8284e2787c438c242c3bb0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c159167d-a6dd-494b-b8ad-5a5535eb775c,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:36Z,use_quota=True,user_id='30bf6550b8da48719d42a0bc5f4402fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1a981e-5053-4182-873d-eee94deed1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1a981e-5053-4182-873d-eee94deed1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbb980e-d53f-47da-9bff-fbcf1967d568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbb980e-d53f-47da-9bff-fbcf1967d568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'daadd69d-5ac9-4d2f-af07-c84711ed0d93', 'volume_name': 'volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93', 'volume_size': 1, 'source_volid': 'c159167d-a6dd-494b-b8ad-5a5535eb775c', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59447180-07f3-4074-9229-5f04169eb0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59447180-07f3-4074-9229-5f04169eb0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9aa3a1-84d1-4f87-b959-ddec2c6eaf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:36 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Volume daadd69d-5ac9-4d2f-af07-c84711ed0d93: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93', 'volume_size': 1, 'source_volid': 'c159167d-a6dd-494b-b8ad-5a5535eb775c', 'source_volstatus': 'available'} Aug 01 15:07:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:36 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Cloning volume c159167d-a6dd-494b-b8ad-5a5535eb775c to volume daadd69d-5ac9-4d2f-af07-c84711ed0d93 Aug 01 15:07:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Creating offline snapshot 94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c of volume c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:07:36 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca28c330-a088-4205-b0ea-d430d2c86108]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:36 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c Aug 01 15:07:36 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:36 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c" returned: 0 in 0.429s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:36 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c 1G Aug 01 15:07:36 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:37 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c 1G" returned: 0 in 0.515s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c159167d-a6dd-494b-b8ad-5a5535eb775c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:37 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c159167d-a6dd-494b-b8ad-5a5535eb775c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c Aug 01 15:07:37 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=96,cinder:SELECT=90,cinder:DELETE=6,cinder:INSERT=40 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=111,cinder:INSERT=23,cinder:UPDATE=95,cinder:DELETE=11 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-edf4fca3-8176-45a3-8589-35e85839ba8b req-8a41e2fd-b04a-4e25-9160-3c4686e03ca8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:37 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c159167d-a6dd-494b-b8ad-5a5535eb775c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c" returned: 0 in 0.339s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:37 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c is being set with open permissions: ugo+rw Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:37 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c Aug 01 15:07:37 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:37 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c" returned: 0 in 0.252s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:37 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.info Aug 01 15:07:37 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Flow 'volume_create_manager' (96451dc2-c066-48de-8a28-45dfe8fdafb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b414627-f4be-416d-a196-50fbc8412251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:37 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.info" returned: 0 in 0.267s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:37 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.info is being set with open permissions: ugo+rw Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:37 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.info Aug 01 15:07:37 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b414627-f4be-416d-a196-50fbc8412251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1863017970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918d82c4-286e-4b44-ac7a-0b3ea6989a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e03fb0bfff48ffb145eebb6c7694f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:38Z,use_quota=True,user_id='6dd8132841294e7d81d3d5a737c89160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef331057-1ba8-475d-b02a-3a8457fcaafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef331057-1ba8-475d-b02a-3a8457fcaafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e188fa60-5f13-4c95-90b0-8dd496135e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e188fa60-5f13-4c95-90b0-8dd496135e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918d82c4-286e-4b44-ac7a-0b3ea6989a03', 'volume_name': 'volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ea20c2-1dd2-4e18-b9f8-3721957d2dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ea20c2-1dd2-4e18-b9f8-3721957d2dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79658fc-6f59-41e0-bba6-08b5c3de6dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:38 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Volume 918d82c4-286e-4b44-ac7a-0b3ea6989a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03', 'volume_size': 1} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:38 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.info" returned: 0 in 0.268s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-quobyte-daadd69d-5ac9-4d2f-af07-c84711ed0d93" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-daadd69d-5ac9-4d2f-af07-c84711ed0d93" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] snapshot: 94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c, volume: daadd69d-5ac9-4d2f-af07-c84711ed0d93, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b012a0-cc08-4e4f-8d85-100da194cd77]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:38 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c Aug 01 15:07:38 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:38 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c" returned: 0 in 0.362s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c159167d-a6dd-494b-b8ad-5a5535eb775c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[84985e6b-a91a-43e5-8aa9-1e01eaa616d7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:38 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c Aug 01 15:07:38 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:39 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c" returned: 0 in 0.382s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:07:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:07:39 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:07:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:39 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 Aug 01 15:07:39 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:40 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93" returned: 0 in 1.129s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c, size 1024.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:07:40 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Converted 1024.00 MB image at 905.67 MB/s Aug 01 15:07:40 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 is being set with open permissions: ugo+rw Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:40 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 Aug 01 15:07:40 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:40 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93" returned: 0 in 0.235s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-daadd69d-5ac9-4d2f-af07-c84711ed0d93" released by "_copy_volume_from_snapshot" :: held 2.173s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-quobyte-94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Deleting offline snapshot 94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c of volume c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] snapshot_file for this snap is: volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[576a32fe-ff98-4580-ac37-f37098d67150]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:40 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c Aug 01 15:07:40 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:40 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c" returned: 0 in 0.339s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c159167d-a6dd-494b-b8ad-5a5535eb775c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fece4de-005a-4d65-89e8-0cc3d917573f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:40 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c Aug 01 15:07:40 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:41 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:41 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c Aug 01 15:07:41 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:41 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c" returned: 0 in 0.338s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:41 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c Aug 01 15:07:41 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:41 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c.94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c" returned: 0 in 0.246s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-94cf59aa-4b9c-4c5c-9cc4-5e5ba6c6234c" released by "_delete_snapshot" :: held 1.362s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.790s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Marking volume daadd69d-5ac9-4d2f-af07-c84711ed0d93 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-edf4fca3-8176-45a3-8589-35e85839ba8b req-8a41e2fd-b04a-4e25-9160-3c4686e03ca8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.547s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Copying metadata from source volume c159167d-a6dd-494b-b8ad-5a5535eb775c to daadd69d-5ac9-4d2f-af07-c84711ed0d93. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-edf4fca3-8176-45a3-8589-35e85839ba8b req-8a41e2fd-b04a-4e25-9160-3c4686e03ca8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.855s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1863017970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918d82c4-286e-4b44-ac7a-0b3ea6989a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e03fb0bfff48ffb145eebb6c7694f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:38Z,use_quota=True,user_id='6dd8132841294e7d81d3d5a737c89160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Creating volume 918d82c4-286e-4b44-ac7a-0b3ea6989a03 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:07:41 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:41 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03 1073741824 Aug 01 15:07:41 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-edf4fca3-8176-45a3-8589-35e85839ba8b req-8a41e2fd-b04a-4e25-9160-3c4686e03ca8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b41487b-7536-4f5d-b807-785d5e94b5c4', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9aa3a1-84d1-4f87-b959-ddec2c6eaf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93', 'volume_size': 1, 'source_volid': 'c159167d-a6dd-494b-b8ad-5a5535eb775c', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59d7a79-8008-4cac-a04d-e68475c1373d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-edf4fca3-8176-45a3-8589-35e85839ba8b req-8a41e2fd-b04a-4e25-9160-3c4686e03ca8 tempest-TestInstancesWithCinderVolumes-1175008379 None] attachment_update completed successfully. Aug 01 15:07:42 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Volume volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 (daadd69d-5ac9-4d2f-af07-c84711ed0d93): created successfully Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59d7a79-8008-4cac-a04d-e68475c1373d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Flow 'volume_create_manager' (ed801590-7a03-432d-a75f-648cf471d437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-31cc9edc-0ef9-4955-b8e2-a8c478c7b332 tempest-VolumesCloneTest-749649770 None] Created volume successfully. Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-daadd69d-5ac9-4d2f-af07-c84711ed0d93-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Lock "cinder-daadd69d-5ac9-4d2f-af07-c84711ed0d93-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:42 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03 1073741824" returned: 0 in 0.623s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-quobyte-daadd69d-5ac9-4d2f-af07-c84711ed0d93" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-daadd69d-5ac9-4d2f-af07-c84711ed0d93" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:42 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03 Aug 01 15:07:42 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90279cf-30b8-466f-9073-2af8b55b2379]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:42 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 Aug 01 15:07:42 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:42 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03" returned: 0 in 0.287s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79658fc-6f59-41e0-bba6-08b5c3de6dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ecaed2-afc0-43f6-9d7b-fabc012010f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:42 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Volume volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03 (918d82c4-286e-4b44-ac7a-0b3ea6989a03): created successfully Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ecaed2-afc0-43f6-9d7b-fabc012010f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Flow 'volume_create_manager' (96451dc2-c066-48de-8a28-45dfe8fdafb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-735779cb-b4ba-431c-938f-b2b320076156 tempest-VolumesTransfersV355Test-135288075 None] Created volume successfully. Aug 01 15:07:43 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93" returned: 0 in 0.395s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:43 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93 Aug 01 15:07:43 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:43 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-daadd69d-5ac9-4d2f-af07-c84711ed0d93" returned: 0 in 0.254s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-daadd69d-5ac9-4d2f-af07-c84711ed0d93" released by "delete_volume" :: held 0.720s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Created reservations ['fe9d24d2-6e19-4e32-9d6e-68fa8e445b75', '2e268834-ada1-4e5d-b6d5-86c4704e0ad7', 'e1886c5a-3cfe-422e-a050-c48dd5286497', 'e6ed7672-d92e-43d1-a5b3-282b9fa31e0f'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:43 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:07:43 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:43 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.290s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:07:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Deleted volume successfully. Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b62d6692-4627-4670-9be1-5af127687762 tempest-VolumesCloneTest-749649770 None] Lock "cinder-daadd69d-5ac9-4d2f-af07-c84711ed0d93-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-c159167d-a6dd-494b-b8ad-5a5535eb775c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Lock "cinder-c159167d-a6dd-494b-b8ad-5a5535eb775c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-quobyte-c159167d-a6dd-494b-b8ad-5a5535eb775c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-c159167d-a6dd-494b-b8ad-5a5535eb775c" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78168c0-f0a8-4454-b757-64d5c145172d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cfd6e9d6-a2db-4b2a-863f-df1ef70bf59c tempest-VolumesTransfersV355Test-1114630709 None] Transfer volume completed successfully. Aug 01 15:07:43 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c Aug 01 15:07:43 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:44 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c" returned: 0 in 0.411s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:44 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c Aug 01 15:07:44 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Acquiring lock "cinder-918d82c4-286e-4b44-ac7a-0b3ea6989a03-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Lock "cinder-918d82c4-286e-4b44-ac7a-0b3ea6989a03-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Acquiring lock "cinder-quobyte-918d82c4-286e-4b44-ac7a-0b3ea6989a03" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Lock "cinder-quobyte-918d82c4-286e-4b44-ac7a-0b3ea6989a03" acquired by "delete_volume" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f5d391-1b15-4afd-9cbf-1bd4c5541e64]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:44 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c159167d-a6dd-494b-b8ad-5a5535eb775c" returned: 0 in 0.364s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-c159167d-a6dd-494b-b8ad-5a5535eb775c" released by "delete_volume" :: held 0.869s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:44 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03 Aug 01 15:07:44 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Created reservations ['4ac40697-b245-4052-8b9d-842df5f1dd2e', '28ad63a6-b19b-4c87-b5fc-62b73e7d8704', 'f2cd7a95-26d0-4b64-8113-ded9b5f715f2', '3bf9e80b-5826-48fb-998b-7f7322313fbd'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:44 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:07:44 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-b843ac83-0ef8-48d4-8d51-7e7f38a932eb req-851e11f7-545e-4b7e-8db2-1980d8f951b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-b843ac83-0ef8-48d4-8d51-7e7f38a932eb req-851e11f7-545e-4b7e-8db2-1980d8f951b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-b843ac83-0ef8-48d4-8d51-7e7f38a932eb req-851e11f7-545e-4b7e-8db2-1980d8f951b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-b843ac83-0ef8-48d4-8d51-7e7f38a932eb req-851e11f7-545e-4b7e-8db2-1980d8f951b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-d334de2f-ba85-4898-8881-42b0d5c2e251', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3049a7e9-0b96-47ce-8852-e07be5948a4d', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:07:45 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03" returned: 0 in 0.628s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:45 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03 Aug 01 15:07:45 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-b843ac83-0ef8-48d4-8d51-7e7f38a932eb req-851e11f7-545e-4b7e-8db2-1980d8f951b4 tempest-TestInstancesWithCinderVolumes-1175008379 None] attachment_update completed successfully. Aug 01 15:07:45 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.472s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:07:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Deleted volume successfully. Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fb8e2639-6240-4117-8cfd-89f612311d68 tempest-VolumesCloneTest-749649770 None] Lock "cinder-c159167d-a6dd-494b-b8ad-5a5535eb775c-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:45 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-918d82c4-286e-4b44-ac7a-0b3ea6989a03" returned: 0 in 0.400s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Lock "cinder-quobyte-918d82c4-286e-4b44-ac7a-0b3ea6989a03" released by "delete_volume" :: held 1.097s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Created reservations ['0b423d34-34da-432c-aa82-4a4ad2c845b7', '1e496181-a299-4a24-88e8-84b968538604', '72712d8f-c2b7-443e-8bf5-0f79caa8356f', 'e5b65c1f-3da2-4882-8106-d50375ee14ce'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Flow 'volume_create_manager' (fcf2a2ef-92b2-4708-bf36-f0b414aee990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b48f761-ac00-45ff-854f-02904eb1f0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b48f761-ac00-45ff-854f-02904eb1f0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-716965117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cffe9d-b324-4b9d-ad65-ec708f03ef8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe4f069b8284e2787c438c242c3bb0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:46Z,use_quota=True,user_id='30bf6550b8da48719d42a0bc5f4402fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f86c125-2984-46f2-b34b-e65add3b0413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f86c125-2984-46f2-b34b-e65add3b0413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafc20d3-1eec-44df-bde1-6dc583ea1eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafc20d3-1eec-44df-bde1-6dc583ea1eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16cffe9d-b324-4b9d-ad65-ec708f03ef8d', 'volume_name': 'volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8669eeba-949f-4510-b4b9-7448b2836d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8669eeba-949f-4510-b4b9-7448b2836d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed81e4b-2c4e-403c-afb9-fbb1a4acf80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:45 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Volume 16cffe9d-b324-4b9d-ad65-ec708f03ef8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d', 'volume_size': 1} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-716965117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cffe9d-b324-4b9d-ad65-ec708f03ef8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe4f069b8284e2787c438c242c3bb0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:46Z,use_quota=True,user_id='30bf6550b8da48719d42a0bc5f4402fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Creating volume 16cffe9d-b324-4b9d-ad65-ec708f03ef8d {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:07:45 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:45 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d 1073741824 Aug 01 15:07:45 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:45 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:07:45 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:46 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.508s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:46 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:07:46 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Deleted volume successfully. Aug 01 15:07:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c9737432-e78c-4e1e-bdd8-59ae48b65c5f tempest-VolumesTransfersV355Test-294889570 None] Lock "cinder-918d82c4-286e-4b44-ac7a-0b3ea6989a03-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:46 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d 1073741824" returned: 0 in 0.957s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:46 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d Aug 01 15:07:46 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:47 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d" returned: 0 in 0.443s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed81e4b-2c4e-403c-afb9-fbb1a4acf80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21799df2-7bfa-4b9f-a4df-1e32929dedbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Volume volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d (16cffe9d-b324-4b9d-ad65-ec708f03ef8d): created successfully Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21799df2-7bfa-4b9f-a4df-1e32929dedbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Flow 'volume_create_manager' (fcf2a2ef-92b2-4708-bf36-f0b414aee990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0b2bfa39-8dac-40ce-af8a-0ccd71903d82 tempest-VolumesCloneTest-749649770 None] Created volume successfully. Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Flow 'volume_create_manager' (577641f1-3244-43c0-8eed-143f352fcdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c70710-e045-4ca5-87e1-345fb2f3388f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c70710-e045-4ca5-87e1-345fb2f3388f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-267032862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9084625d-6dcf-4bcb-9df3-d07464aa481e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e03fb0bfff48ffb145eebb6c7694f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:47Z,use_quota=True,user_id='6dd8132841294e7d81d3d5a737c89160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47aa9b43-a606-4c05-976c-b909fbde9fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47aa9b43-a606-4c05-976c-b909fbde9fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0821d97d-eb5c-458d-af8e-913c944bb99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0821d97d-eb5c-458d-af8e-913c944bb99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9084625d-6dcf-4bcb-9df3-d07464aa481e', 'volume_name': 'volume-9084625d-6dcf-4bcb-9df3-d07464aa481e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5527696d-bc2e-4c0c-8385-4894a377bf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5527696d-bc2e-4c0c-8385-4894a377bf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee371a9-2047-4dd4-b1da-1dc3a8d75086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Volume 9084625d-6dcf-4bcb-9df3-d07464aa481e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9084625d-6dcf-4bcb-9df3-d07464aa481e', 'volume_size': 1} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-267032862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9084625d-6dcf-4bcb-9df3-d07464aa481e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e03fb0bfff48ffb145eebb6c7694f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:47Z,use_quota=True,user_id='6dd8132841294e7d81d3d5a737c89160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Creating volume 9084625d-6dcf-4bcb-9df3-d07464aa481e {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:07:47 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:07:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:47 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e 1073741824 Aug 01 15:07:47 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:48 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e 1073741824" returned: 0 in 0.630s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:48 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e Aug 01 15:07:48 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:48 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e" returned: 0 in 0.383s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee371a9-2047-4dd4-b1da-1dc3a8d75086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9084625d-6dcf-4bcb-9df3-d07464aa481e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3057caa-e46b-45de-b5c9-00eb4b6a0a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Flow 'volume_create_manager' (1261e4e6-77a0-4a2e-8828-3848cddebf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f092db-78a9-438b-8911-62a0f69e24c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:48 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Volume volume-9084625d-6dcf-4bcb-9df3-d07464aa481e (9084625d-6dcf-4bcb-9df3-d07464aa481e): created successfully Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3057caa-e46b-45de-b5c9-00eb4b6a0a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Flow 'volume_create_manager' (577641f1-3244-43c0-8eed-143f352fcdfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f092db-78a9-438b-8911-62a0f69e24c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1229592420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f567f76-2e16-405f-9366-ab60bf8ae68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe4f069b8284e2787c438c242c3bb0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:07:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=16cffe9d-b324-4b9d-ad65-ec708f03ef8d,status='creating',terminated_at=None,updated_at=2026-08-01T13:07:49Z,use_quota=True,user_id='30bf6550b8da48719d42a0bc5f4402fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1567a4cf-7570-4d7d-bf1a-9b07cea8c99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1567a4cf-7570-4d7d-bf1a-9b07cea8c99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e3acae-a6da-4162-a8ce-463b2b31a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-efd5ef42-ae98-4bc8-912d-606d119eefc9 tempest-VolumesTransfersV355Test-135288075 None] Created volume successfully. Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e3acae-a6da-4162-a8ce-463b2b31a725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2f567f76-2e16-405f-9366-ab60bf8ae68a', 'volume_name': 'volume-2f567f76-2e16-405f-9366-ab60bf8ae68a', 'volume_size': 2, 'source_volid': '16cffe9d-b324-4b9d-ad65-ec708f03ef8d', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8935d232-0963-400d-aa41-a0aea3463119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8935d232-0963-400d-aa41-a0aea3463119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72e4b55-9eda-4db2-a9e4-06de4d7b99a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:07:48 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Volume 2f567f76-2e16-405f-9366-ab60bf8ae68a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2f567f76-2e16-405f-9366-ab60bf8ae68a', 'volume_size': 2, 'source_volid': '16cffe9d-b324-4b9d-ad65-ec708f03ef8d', 'source_volstatus': 'available'} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:48 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Cloning volume 16cffe9d-b324-4b9d-ad65-ec708f03ef8d to volume 2f567f76-2e16-405f-9366-ab60bf8ae68a Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Creating offline snapshot 8315f409-3ff4-4544-94ae-b4557ef74b30 of volume 16cffe9d-b324-4b9d-ad65-ec708f03ef8d {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2589af-85db-4a54-a188-0435be934aec]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:49 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d Aug 01 15:07:49 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:49 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d" returned: 0 in 0.452s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:49 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 1G Aug 01 15:07:49 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:50 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 1G" returned: 0 in 0.690s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:50 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 Aug 01 15:07:50 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Acquiring lock "cinder-9084625d-6dcf-4bcb-9df3-d07464aa481e-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Lock "cinder-9084625d-6dcf-4bcb-9df3-d07464aa481e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Acquiring lock "cinder-quobyte-9084625d-6dcf-4bcb-9df3-d07464aa481e" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Lock "cinder-quobyte-9084625d-6dcf-4bcb-9df3-d07464aa481e" acquired by "delete_volume" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e7a546-8862-4142-ac47-4d77b9b0996e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:50 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e Aug 01 15:07:50 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:50 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30" returned: 0 in 0.472s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:50 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 is being set with open permissions: ugo+rw Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:50 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 Aug 01 15:07:50 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:50 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e" returned: 0 in 0.454s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:50 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e Aug 01 15:07:50 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:50 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30" returned: 0 in 0.326s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:50 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.info Aug 01 15:07:50 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:51 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9084625d-6dcf-4bcb-9df3-d07464aa481e" returned: 0 in 0.386s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Lock "cinder-quobyte-9084625d-6dcf-4bcb-9df3-d07464aa481e" released by "delete_volume" :: held 0.894s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:51 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Created reservations ['c81775d2-e0b6-4aaa-99a7-9c23f49765d4', '15e59fa5-594e-4046-89b8-81039110b6f6', 'adf30acd-bb70-48d4-92c3-f31b8124c980', '29aab429-875d-4f9d-8b52-97efafe352fe'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.info" returned: 0 in 0.361s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:51 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.info is being set with open permissions: ugo+rw Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:51 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.info Aug 01 15:07:51 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:51 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:07:51 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:51 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.info" returned: 0 in 0.315s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-quobyte-2f567f76-2e16-405f-9366-ab60bf8ae68a" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-2f567f76-2e16-405f-9366-ab60bf8ae68a" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] snapshot: 8315f409-3ff4-4544-94ae-b4557ef74b30, volume: 2f567f76-2e16-405f-9366-ab60bf8ae68a, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[923a6367-5ca0-42ee-aa0f-dfc7f43b18f9]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-e637f23f-b443-4861-928b-613b98bb41fd req-4f97da79-d520-42f4-8e90-98f4e4de0238 tempest-AttachVolumeNegativeTest-1581032568 None] Terminate volume connection completed successfully. Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-e637f23f-b443-4861-928b-613b98bb41fd req-4f97da79-d520-42f4-8e90-98f4e4de0238 tempest-AttachVolumeNegativeTest-1581032568 None] Deleting attachment 1a61c5ca-d0d2-46f7-b533-b79df57e3954. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:07:51 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.422s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:07:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Deleted volume successfully. Aug 01 15:07:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e22f3481-a7a9-45a0-b8cb-d27ea036e98b tempest-VolumesTransfersV355Test-294889570 None] Lock "cinder-9084625d-6dcf-4bcb-9df3-d07464aa481e-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:51 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 Aug 01 15:07:51 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-f7e1a2c0-b2f9-4fbb-8539-57b9345ba7fb req-9f7f3ad2-6bf0-4c90-b753-28f82a247840 tempest-TestInstancesWithCinderVolumes-1175008379 None] Terminate volume connection completed successfully. Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-f7e1a2c0-b2f9-4fbb-8539-57b9345ba7fb req-9f7f3ad2-6bf0-4c90-b753-28f82a247840 tempest-TestInstancesWithCinderVolumes-1175008379 None] Deleting attachment 2b41487b-7536-4f5d-b807-785d5e94b5c4. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:07:52 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30" returned: 0 in 0.597s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[81430eaa-4401-4d80-8985-8bcfb5126db8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:52 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d Aug 01 15:07:52 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "cinder-bc6def45-f4ae-4896-b6d7-1b4c310e1999-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-bc6def45-f4ae-4896-b6d7-1b4c310e1999-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "cinder-quobyte-bc6def45-f4ae-4896-b6d7-1b4c310e1999" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-quobyte-bc6def45-f4ae-4896-b6d7-1b4c310e1999" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe1e65c-3e1f-4af4-b07f-08660b37692e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:52 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d" returned: 0 in 0.568s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:07:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:52 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999 Aug 01 15:07:52 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:52 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a Aug 01 15:07:52 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:53 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999" returned: 0 in 0.800s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:53 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999 Aug 01 15:07:53 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:53 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bc6def45-f4ae-4896-b6d7-1b4c310e1999" returned: 0 in 0.370s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-quobyte-bc6def45-f4ae-4896-b6d7-1b4c310e1999" released by "delete_volume" :: held 1.243s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:54 devstack cinder-volume[89024]: WARNING cinder.quota [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1660151433-1874600657 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1660151433-1874600657, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:07:54 devstack cinder-volume[89024]: WARNING cinder.quota [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1660151433-1874600657 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1660151433-1874600657, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:07:54 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Created reservations ['05cd0ec4-92df-47ed-9deb-813b02dab6ca', 'd2fe8e3f-26ad-4bf9-bca5-d109eb5e1e3b', '38b36e29-0f91-47d1-a662-e3ba23578a9f', 'f8950367-df2b-43ff-ae25-5c20cc412b56'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:07:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:07:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:07:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:07:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:07:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:07:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:07:54 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:07:54 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:07:55 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Aug 01 15:07:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.715s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:07:55 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:07:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Deleted volume successfully. Aug 01 15:07:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5a274ac-05a5-4b4a-9a9c-dd652cb2bd1b tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-bc6def45-f4ae-4896-b6d7-1b4c310e1999-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:07:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-dd0fe1fe-e40e-408a-a197-684f941345a5 req-8328a4ee-4fe4-4924-b7ba-2c0e31cfa503 tempest-TestInstancesWithCinderVolumes-1175008379 None] Terminate volume connection completed successfully. Aug 01 15:07:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-dd0fe1fe-e40e-408a-a197-684f941345a5 req-8328a4ee-4fe4-4924-b7ba-2c0e31cfa503 tempest-TestInstancesWithCinderVolumes-1175008379 None] Deleting attachment 3049a7e9-0b96-47ce-8852-e07be5948a4d. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:08:00 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a" returned: 0 in 7.214s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d, size 1024.00 MB, duration 7.22 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:08:00 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Converted 1024.00 MB image at 141.92 MB/s Aug 01 15:08:00 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a is being set with open permissions: ugo+rw Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:00 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a Aug 01 15:08:00 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:00 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a" returned: 0 in 0.283s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-2f567f76-2e16-405f-9366-ab60bf8ae68a" released by "_copy_volume_from_snapshot" :: held 8.749s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-quobyte-8315f409-3ff4-4544-94ae-b4557ef74b30" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-8315f409-3ff4-4544-94ae-b4557ef74b30" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Deleting offline snapshot 8315f409-3ff4-4544-94ae-b4557ef74b30 of volume 16cffe9d-b324-4b9d-ad65-ec708f03ef8d {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] snapshot_file for this snap is: volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed14fda-e19e-43d7-9af7-c1524928241a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:00 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 Aug 01 15:08:00 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:00 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30" returned: 0 in 0.482s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:08:00 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[53957dd0-1326-4892-937a-db2d86261f8f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "cinder-d334de2f-ba85-4898-8881-42b0d5c2e251-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-d334de2f-ba85-4898-8881-42b0d5c2e251-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "cinder-quobyte-d334de2f-ba85-4898-8881-42b0d5c2e251" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:01 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d Aug 01 15:08:01 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-quobyte-d334de2f-ba85-4898-8881-42b0d5c2e251" acquired by "delete_volume" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:01 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[927c4820-2236-4cc2-b0a5-38f3385eb7c7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:01 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251 Aug 01 15:08:01 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:01 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d" returned: 0 in 0.732s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:01 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 Aug 01 15:08:01 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:01 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251" returned: 0 in 0.547s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:01 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251 Aug 01 15:08:01 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:02 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d334de2f-ba85-4898-8881-42b0d5c2e251" returned: 0 in 0.396s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-quobyte-d334de2f-ba85-4898-8881-42b0d5c2e251" released by "delete_volume" :: held 1.034s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:02 devstack cinder-volume[89024]: WARNING cinder.quota [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-799902116-1279479024 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-799902116-1279479024, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:08:02 devstack cinder-volume[89024]: WARNING cinder.quota [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-799902116-1279479024 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-799902116-1279479024, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:08:02 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30" returned: 0 in 0.555s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:02 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30 Aug 01 15:08:02 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Created reservations ['9d914d86-68d9-4a49-8745-cb2376f97d1a', '7ea37153-5cd8-46a8-a1c2-7c6802739ce7', '7229df84-bb79-407d-9da8-45adca76f91a', 'fb149e1f-f0d5-4171-8ef1-202d7d0411ac'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:02 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:08:02 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:02 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d.8315f409-3ff4-4544-94ae-b4557ef74b30" returned: 0 in 0.383s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-8315f409-3ff4-4544-94ae-b4557ef74b30" released by "_delete_snapshot" :: held 2.297s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:02 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.329s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:08:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Deleted volume successfully. Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49d7fedc-0ffb-4c44-acd2-1f83d3949df2 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-d334de2f-ba85-4898-8881-42b0d5c2e251-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.974s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d72e4b55-9eda-4db2-a9e4-06de4d7b99a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f567f76-2e16-405f-9366-ab60bf8ae68a', 'volume_size': 2, 'source_volid': '16cffe9d-b324-4b9d-ad65-ec708f03ef8d', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06ecbe1-a348-4503-ba8a-3a4e6e7bd60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:02 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Volume volume-2f567f76-2e16-405f-9366-ab60bf8ae68a (2f567f76-2e16-405f-9366-ab60bf8ae68a): created successfully Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06ecbe1-a348-4503-ba8a-3a4e6e7bd60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Flow 'volume_create_manager' (1261e4e6-77a0-4a2e-8828-3848cddebf42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c5c79171-4cc7-47d6-ac22-99e22190c3da tempest-VolumesCloneTest-749649770 None] Created volume successfully. Aug 01 15:08:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-2f567f76-2e16-405f-9366-ab60bf8ae68a-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Lock "cinder-2f567f76-2e16-405f-9366-ab60bf8ae68a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-quobyte-2f567f76-2e16-405f-9366-ab60bf8ae68a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-2f567f76-2e16-405f-9366-ab60bf8ae68a" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:03 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe62490-6329-4183-ba6f-78e40940bfff]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:03 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a Aug 01 15:08:03 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:04 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a" returned: 0 in 0.509s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:04 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a Aug 01 15:08:04 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:04 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f567f76-2e16-405f-9366-ab60bf8ae68a" returned: 0 in 0.388s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-2f567f76-2e16-405f-9366-ab60bf8ae68a" released by "delete_volume" :: held 0.960s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:04 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Created reservations ['4c1c6101-e70f-4861-aefe-b4ef68c044c9', '163369e0-da2e-4a12-b623-e7e0ab979fee', '4262e912-2b27-4c68-a7bd-088d39462ebf', '1409399e-9ee0-42fa-b12c-fb69ba39b9dd'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:08:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:04 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:08:04 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:05 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.433s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:05 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:08:05 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Deleted volume successfully. Aug 01 15:08:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-97124cc0-5f59-4417-9857-b46872e94ff3 tempest-VolumesCloneTest-749649770 None] Lock "cinder-2f567f76-2e16-405f-9366-ab60bf8ae68a-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-16cffe9d-b324-4b9d-ad65-ec708f03ef8d-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Lock "cinder-16cffe9d-b324-4b9d-ad65-ec708f03ef8d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Acquiring lock "cinder-quobyte-16cffe9d-b324-4b9d-ad65-ec708f03ef8d" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-16cffe9d-b324-4b9d-ad65-ec708f03ef8d" acquired by "delete_volume" :: waited 0.041s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2822eafa-7935-45e0-b79e-2d36350b2586]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:06 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d Aug 01 15:08:06 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Flow 'volume_create_manager' (b79a83c7-4292-4568-a9ee-252fd24c48e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d90d692-ea31-40c1-872b-a320318950e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d90d692-ea31-40c1-872b-a320318950e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-263236483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ba0635-2bdb-44ca-b955-cd4608ab8e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b7cad05fbe40eca3f59147795336ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:07Z,use_quota=True,user_id='eb01e6d6c637444498aa60b6363ccabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0af19a-b6dc-4e27-9485-cdb439f20c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0af19a-b6dc-4e27-9485-cdb439f20c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:06 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdc0967-3694-4b18-a066-fc7a6b52ae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cdc0967-3694-4b18-a066-fc7a6b52ae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ba0635-2bdb-44ca-b955-cd4608ab8e35', 'volume_name': 'volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655a7f95-f5a5-4298-ae53-036f5bda642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655a7f95-f5a5-4298-ae53-036f5bda642b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc7b464-076f-4324-b5b6-10c207cdda65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:06 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Volume 52ba0635-2bdb-44ca-b955-cd4608ab8e35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35', 'volume_size': 1} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-263236483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ba0635-2bdb-44ca-b955-cd4608ab8e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b7cad05fbe40eca3f59147795336ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:07Z,use_quota=True,user_id='eb01e6d6c637444498aa60b6363ccabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Creating volume 52ba0635-2bdb-44ca-b955-cd4608ab8e35 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:08:06 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d" returned: 0 in 0.692s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:06 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35 1073741824 Aug 01 15:08:06 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:06 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d Aug 01 15:08:06 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:07 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-16cffe9d-b324-4b9d-ad65-ec708f03ef8d" returned: 0 in 0.417s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Lock "cinder-quobyte-16cffe9d-b324-4b9d-ad65-ec708f03ef8d" released by "delete_volume" :: held 1.198s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Created reservations ['893b2388-5343-49cf-9f57-ce0ed03c156c', '49ea5c06-444e-446a-8945-d8310680b245', '424d744e-6dd6-4fea-9397-045cec2cbdff', 'e3393123-a033-4996-b46d-5170f2526d42'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:07 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35 1073741824" returned: 0 in 0.733s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:07 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:08:07 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-42a35935-bcae-4633-936c-013a93b1e5c2 req-a099760d-c3c5-43c9-8a4c-409c52fc6d83 tempest-TestInstancesWithCinderVolumes-1175008379 None] Terminate volume connection completed successfully. Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-42a35935-bcae-4633-936c-013a93b1e5c2 req-a099760d-c3c5-43c9-8a4c-409c52fc6d83 tempest-TestInstancesWithCinderVolumes-1175008379 None] Deleting attachment b261222a-61a5-4412-889a-4e27ec1eb2d6. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:08:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:07 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35 Aug 01 15:08:07 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:08 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.490s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:08 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:08:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Deleted volume successfully. Aug 01 15:08:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6ab2f677-8d71-41a5-80ef-485af2b2bb0c tempest-VolumesCloneTest-749649770 None] Lock "cinder-16cffe9d-b324-4b9d-ad65-ec708f03ef8d-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:08 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35" returned: 0 in 0.496s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:08:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc7b464-076f-4324-b5b6-10c207cdda65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d6f083-7751-4522-be07-c2fe1c567238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:08 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Volume volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35 (52ba0635-2bdb-44ca-b955-cd4608ab8e35): created successfully Aug 01 15:08:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d6f083-7751-4522-be07-c2fe1c567238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Flow 'volume_create_manager' (b79a83c7-4292-4568-a9ee-252fd24c48e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e9a01302-1326-4fb3-b6de-66b0bd43580c tempest-VolumesTransfersV357Test-1160330941 None] Created volume successfully. Aug 01 15:08:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "cinder-8056a54d-6b2e-45ee-87b9-90d128a9ded2-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-8056a54d-6b2e-45ee-87b9-90d128a9ded2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "cinder-quobyte-8056a54d-6b2e-45ee-87b9-90d128a9ded2" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-quobyte-8056a54d-6b2e-45ee-87b9-90d128a9ded2" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90ab452-1458-4aee-92a0-1ade101ce9c0]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:09 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 Aug 01 15:08:09 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-df9f0400-4c7d-4e69-8bd5-da5ed13336a2 tempest-VolumesTransfersV357Test-2022360800 None] Transfer volume completed successfully. Aug 01 15:08:10 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2" returned: 0 in 0.473s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:10 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2 Aug 01 15:08:10 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:10 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8056a54d-6b2e-45ee-87b9-90d128a9ded2" returned: 0 in 0.339s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-quobyte-8056a54d-6b2e-45ee-87b9-90d128a9ded2" released by "delete_volume" :: held 0.865s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:10 devstack cinder-volume[89024]: WARNING cinder.quota [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486733931-807757967 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486733931-807757967, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:08:10 devstack cinder-volume[89024]: WARNING cinder.quota [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486733931-807757967 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-486733931-807757967, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Created reservations ['e9781d10-4004-4c84-9468-09fdf8291237', 'abc4f16c-ffb8-4354-924d-dbb983a3fa35', '2311bad2-e127-4bc9-b632-ce4a5f3c8d05', 'b963cfb9-67f6-4fdc-a768-24e0d6fab1db'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Acquiring lock "cinder-52ba0635-2bdb-44ca-b955-cd4608ab8e35-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:10 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:08:10 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Lock "cinder-52ba0635-2bdb-44ca-b955-cd4608ab8e35-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Acquiring lock "cinder-quobyte-52ba0635-2bdb-44ca-b955-cd4608ab8e35" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Lock "cinder-quobyte-52ba0635-2bdb-44ca-b955-cd4608ab8e35" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec06805d-3ecb-4ada-93d3-b272f78f3453]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:10 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35 Aug 01 15:08:10 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.501s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:11 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:08:11 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:11 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Deleted volume successfully. Aug 01 15:08:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f0ad3aed-c0d3-44cf-ab43-14bdd4ea09b8 tempest-TestInstancesWithCinderVolumes-1175008379 None] Lock "cinder-8056a54d-6b2e-45ee-87b9-90d128a9ded2-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:11 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35" returned: 0 in 0.854s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:11 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35 Aug 01 15:08:11 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:12 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-52ba0635-2bdb-44ca-b955-cd4608ab8e35" returned: 0 in 0.512s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Lock "cinder-quobyte-52ba0635-2bdb-44ca-b955-cd4608ab8e35" released by "delete_volume" :: held 1.436s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Created reservations ['9183aa09-34d8-4e3d-a1db-32c90e21e407', '7965f71b-9d23-4dd6-ba04-ce8821cb8742', '4a4abfb6-1f4c-4379-af6c-bfbc5a7a884d', 'f88f8145-733b-46b1-88c6-609ed209babf'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:12 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:08:12 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:12 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:08:12 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Deleted volume successfully. Aug 01 15:08:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c112b92d-7a34-4fa3-8967-a562cdea8ef0 tempest-VolumesTransfersV357Test-634461800 None] Lock "cinder-52ba0635-2bdb-44ca-b955-cd4608ab8e35-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Flow 'volume_create_manager' (e3851a3f-8e54-48e5-9ae2-736283cb997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb97fe6-3016-4e89-b0ea-4878b1925a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb97fe6-3016-4e89-b0ea-4878b1925a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-837099907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b7cad05fbe40eca3f59147795336ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:14Z,use_quota=True,user_id='eb01e6d6c637444498aa60b6363ccabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7876557b-927b-49bf-a2f0-2b9e717bb4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7876557b-927b-49bf-a2f0-2b9e717bb4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8002a1-100c-46f8-9f9d-7b65ad7cadba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8002a1-100c-46f8-9f9d-7b65ad7cadba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12', 'volume_name': 'volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1c4a00-05ea-4608-aaf9-540e72909005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1c4a00-05ea-4608-aaf9-540e72909005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17aa830-edf9-4141-9e92-56fb094480f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:14 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Volume e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12', 'volume_size': 1} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-837099907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b7cad05fbe40eca3f59147795336ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:14Z,use_quota=True,user_id='eb01e6d6c637444498aa60b6363ccabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Creating volume e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:08:14 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:08:14 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12 1073741824 Aug 01 15:08:14 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Flow 'volume_create_manager' (91ee9bb7-05d7-411b-a2b4-8c19aeffb6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296f48fc-b47d-4c7a-8b36-56989add46ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296f48fc-b47d-4c7a-8b36-56989add46ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-214957164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de7ff6b91b644fcaadfbcf0cbe95b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:14Z,use_quota=True,user_id='b047d29bef424e6292d6fb670513ba7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880a5ce7-8c51-40bf-9976-7dee23d881b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880a5ce7-8c51-40bf-9976-7dee23d881b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcccb769-652c-4407-b7b0-86b26f6c2a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcccb769-652c-4407-b7b0-86b26f6c2a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9abe7de-5a05-4cbd-8e2d-2d94a16c9a98', 'volume_name': 'volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52861eaa-cc3f-467c-800a-5f536899fe76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52861eaa-cc3f-467c-800a-5f536899fe76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99653e22-fc85-450c-b4c6-31829a90929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:14 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Volume d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Trying to clone d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:08:15 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12 1073741824" returned: 0 in 1.036s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:15 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12 Aug 01 15:08:15 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:08:15 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Image download 20.69 MB at 20.69 MB/s Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0803ffd-70a6-4c29-8b32-d1d5015b62d4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:15 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12" returned: 0 in 0.353s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:15 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD Aug 01 15:08:15 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e17aa830-edf9-4141-9e92-56fb094480f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767521e1-9d83-4704-a7fc-83756ee8ea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:15 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Volume volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12 (e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12): created successfully Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767521e1-9d83-4704-a7fc-83756ee8ea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Flow 'volume_create_manager' (e3851a3f-8e54-48e5-9ae2-736283cb997c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-aff868d8-9235-402b-9a09-cd0e61a662bd tempest-VolumesTransfersV357Test-1160330941 None] Created volume successfully. Aug 01 15:08:16 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD" returned: 0 in 0.557s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf is fetched for user b047d29bef424e6292d6fb670513ba7e. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[78781c5a-9bb5-425e-b9d0-afc2e2ab2695]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:16 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD Aug 01 15:08:16 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Acquiring lock "cinder-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Lock "cinder-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Acquiring lock "cinder-quobyte-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Lock "cinder-quobyte-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12" acquired by "delete_volume" :: waited 0.035s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a4f0f0-756b-453a-bdce-d99b12526b0c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:16 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD" returned: 0 in 0.652s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-214957164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de7ff6b91b644fcaadfbcf0cbe95b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:14Z,use_quota=True,user_id='b047d29bef424e6292d6fb670513ba7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Creating volume d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:08:16 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:08:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:16 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 1073741824 Aug 01 15:08:16 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:17 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12 Aug 01 15:08:17 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:17 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12" returned: 0 in 0.746s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:17 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12 Aug 01 15:08:17 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:17 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:17 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 1073741824" returned: 0 in 0.987s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Lock "cinder-quobyte-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12" released by "delete_volume" :: held 1.159s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:18 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 Aug 01 15:08:18 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Created reservations ['019b719c-31cd-4cbc-ad94-27846dd64959', '502b44f9-6581-4473-b075-9867fe53af64', '58c918a9-7510-405f-bb4f-c70516479271', '86393c83-ff44-43ef-b523-4a9842e31837'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:18 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:08:18 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:18 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98" returned: 0 in 0.546s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Attempting download of a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:08:18 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.396s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:08:18 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:08:18 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Deleted volume successfully. Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a848f21b-b697-4a67-8fcc-5f99944dbb41 tempest-VolumesTransfersV357Test-634461800 None] Lock "cinder-e3f8b1f9-4ea2-4ae9-ade1-0be424c62a12-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9920939-9508-4ee7-be65-4b3e8f9683da]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_e_o_vdpe {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:18 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_e_o_vdpe Aug 01 15:08:18 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:19 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.476s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:08:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:08:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:08:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:08:19 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_e_o_vdpe" returned: 0 in 0.560s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_e_o_vdpe {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:19 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_e_o_vdpe Aug 01 15:08:19 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:19 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_e_o_vdpe" returned: 1 in 0.496s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_e_o_vdpe' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:08:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eb5d9a-48d4-4e46-9165-98264918383e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:19 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD Aug 01 15:08:19 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:20 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD" returned: 0 in 0.565s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:20 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf was qcow2, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:08:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:20 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 Aug 01 15:08:20 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:22 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98" returned: 0 in 2.331s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:22 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf__whn5h48devstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:08:22 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Converted 112.00 MB image at 48.01 MB/s Aug 01 15:08:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:22 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 1G Aug 01 15:08:22 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:23 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 1G" returned: 0 in 0.489s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:23 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Downloaded image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:08:23 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf for user b047d29bef424e6292d6fb670513ba7e is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:08:23 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Marking volume d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:08:23 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Copying metadata from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf to d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:08:23 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Creating volume glance metadata for volume d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 backed by image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:08:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99653e22-fc85-450c-b4c6-31829a90929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fec56ec-f478-43bd-859d-5d06e87db253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:23 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Volume volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 (d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98): created successfully Aug 01 15:08:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fec56ec-f478-43bd-859d-5d06e87db253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Flow 'volume_create_manager' (91ee9bb7-05d7-411b-a2b4-8c19aeffb6d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2aafca95-1292-4d25-b737-9c82689f90c5 tempest-VolumesExtendTest-245510205 None] Created volume successfully. Aug 01 15:08:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-62f23df7-4cee-40c0-84ab-880bcb89cc19 tempest-VolumesExtendTest-245510205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-62f23df7-4cee-40c0-84ab-880bcb89cc19 tempest-VolumesExtendTest-245510205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:24 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c33bfb1-698e-4fbb-a7a7-7f0f863f59d9]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-62f23df7-4cee-40c0-84ab-880bcb89cc19 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:24 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 Aug 01 15:08:24 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:24 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-62f23df7-4cee-40c0-84ab-880bcb89cc19 tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98" returned: 0 in 0.467s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-62f23df7-4cee-40c0-84ab-880bcb89cc19 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 2G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-62f23df7-4cee-40c0-84ab-880bcb89cc19 tempest-VolumesExtendTest-245510205 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 2G" returned: 0 in 0.137s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-62f23df7-4cee-40c0-84ab-880bcb89cc19 tempest-VolumesExtendTest-245510205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.635s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:25 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-62f23df7-4cee-40c0-84ab-880bcb89cc19 tempest-VolumesExtendTest-245510205 None] Extend volume completed successfully. Aug 01 15:08:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Acquiring lock "cinder-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Lock "cinder-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Acquiring lock "cinder-quobyte-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Lock "cinder-quobyte-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:25 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed005ffa-ebaf-46b6-85da-bac086fb0f3d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:26 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 Aug 01 15:08:26 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:26 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98" returned: 0 in 0.449s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:26 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98 Aug 01 15:08:26 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:26 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98" returned: 0 in 0.394s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Lock "cinder-quobyte-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98" released by "delete_volume" :: held 0.922s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:26 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Created reservations ['d5ec439d-4cd9-41b1-99f4-6b18bbc4eabe', 'd026e70f-2039-465c-999c-495d238ad9ce', '276bd0d3-7045-4201-b05e-ded0f2bb3746', '570be4d9-c9b0-4b9f-b67c-43629df9e054'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:27 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:08:27 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:27 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.398s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:08:27 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Deleted volume successfully. Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9df409b8-00a6-42f8-89e4-053ff1517223 tempest-VolumesExtendTest-245510205 None] Lock "cinder-d9abe7de-5a05-4cbd-8e2d-2d94a16c9a98-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Flow 'volume_create_manager' (a5405ef0-998f-4f6c-8415-59cc3265a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd52dd3-6b05-406c-adcd-a79884dce854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd52dd3-6b05-406c-adcd-a79884dce854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1934133676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559d4de0-7434-4874-81c6-8ba84bcd9409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de7ff6b91b644fcaadfbcf0cbe95b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:28Z,use_quota=True,user_id='b047d29bef424e6292d6fb670513ba7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3aa03c-60dc-4b62-ab8e-38b874429433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3aa03c-60dc-4b62-ab8e-38b874429433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d461d2-9b6e-477c-8bb2-6891abd4c0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d461d2-9b6e-477c-8bb2-6891abd4c0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '559d4de0-7434-4874-81c6-8ba84bcd9409', 'volume_name': 'volume-559d4de0-7434-4874-81c6-8ba84bcd9409', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a22ecc-6107-49c0-9722-44bf4ca6fb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a22ecc-6107-49c0-9722-44bf4ca6fb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bb8bce-80a9-4c8b-8e12-94603009bac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:28 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Volume 559d4de0-7434-4874-81c6-8ba84bcd9409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-559d4de0-7434-4874-81c6-8ba84bcd9409', 'volume_size': 1} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1934133676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559d4de0-7434-4874-81c6-8ba84bcd9409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7de7ff6b91b644fcaadfbcf0cbe95b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:28Z,use_quota=True,user_id='b047d29bef424e6292d6fb670513ba7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Creating volume 559d4de0-7434-4874-81c6-8ba84bcd9409 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:08:28 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:28 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 1073741824 Aug 01 15:08:28 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:28 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 1073741824" returned: 0 in 0.555s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:28 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 Aug 01 15:08:28 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:28 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409" returned: 0 in 0.265s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bb8bce-80a9-4c8b-8e12-94603009bac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-559d4de0-7434-4874-81c6-8ba84bcd9409', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ed8b61-b48f-4f91-bdbb-3fc5b60270b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:28 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Volume volume-559d4de0-7434-4874-81c6-8ba84bcd9409 (559d4de0-7434-4874-81c6-8ba84bcd9409): created successfully Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ed8b61-b48f-4f91-bdbb-3fc5b60270b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Flow 'volume_create_manager' (a5405ef0-998f-4f6c-8415-59cc3265a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:28 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8239d534-fb29-4621-af4c-a665fab8b63e tempest-VolumesExtendTest-245510205 None] Created volume successfully. Aug 01 15:08:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] Creating offline snapshot 5568e240-cfdf-44c6-8d73-639bfc9d392d of volume 559d4de0-7434-4874-81c6-8ba84bcd9409 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:08:30 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3f04c1-1730-4f4c-8d8d-5db4faba93cf]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:30 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 Aug 01 15:08:30 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:30 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409" returned: 0 in 0.444s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:30 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d 1G Aug 01 15:08:30 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:31 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d 1G" returned: 0 in 0.456s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-559d4de0-7434-4874-81c6-8ba84bcd9409 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:31 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-559d4de0-7434-4874-81c6-8ba84bcd9409 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d Aug 01 15:08:31 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:31 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-559d4de0-7434-4874-81c6-8ba84bcd9409 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d" returned: 0 in 0.336s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:31 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d is being set with open permissions: ugo+rw Aug 01 15:08:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:31 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d Aug 01 15:08:31 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:32 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d" returned: 0 in 0.420s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:32 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.info Aug 01 15:08:32 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:32 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.info" returned: 0 in 0.291s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:32 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.info is being set with open permissions: ugo+rw Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:32 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.info Aug 01 15:08:32 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:32 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.info" returned: 0 in 0.342s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:32 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6979e871-815b-4e18-ae1d-2cd951afdb9a tempest-VolumesExtendTest-245510205 None] Create snapshot completed successfully Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Flow 'volume_create_manager' (f3915373-0d05-461e-b1aa-8ce9e7a73ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc196ae-fc9f-4014-b822-dc0d922ccdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc196ae-fc9f-4014-b822-dc0d922ccdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9718dcde-d89f-4b88-a3da-bb775965b474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fba95ebf94eea99e5e044c91e7803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:33Z,use_quota=True,user_id='fa7f9a12c077481c805ba466a2b2966b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b14829-3da1-404f-bd80-eb3ff7fc189b),volume_type_id=f0b14829-3da1-404f-bd80-eb3ff7fc189b)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1a82d4-cc6e-47eb-a966-d79269f9eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1a82d4-cc6e-47eb-a966-d79269f9eada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a17ef1-5e6c-4dc5-857b-466debf127ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:32 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a17ef1-5e6c-4dc5-857b-466debf127ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9718dcde-d89f-4b88-a3da-bb775965b474', 'volume_name': 'volume-9718dcde-d89f-4b88-a3da-bb775965b474', 'volume_size': 1, 'image_id': '5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f7f26908fa340bb3a917cb1f0a57cf0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '923fba95ebf94eea99e5e044c91e7803', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6352ac453b95cc212a1ce38d4afef243ed9917a865dc723376a233fd72d4f2b8dd31d6ea7ab9c40f32080b3525ae09602707918d4c4ca7e7d560f99d720abad0', 'id': '5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'created_at': datetime.datetime(2026, 8, 1, 13, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bec3c73-6d7f-4bde-9ec7-87edb6976028/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a288402e-f04e-436b-9e46-0657cd23a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a288402e-f04e-436b-9e46-0657cd23a107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9588c84d-b972-446f-9285-38a35042d726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:33 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Volume 9718dcde-d89f-4b88-a3da-bb775965b474: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9718dcde-d89f-4b88-a3da-bb775965b474', 'volume_size': 1, 'image_id': '5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f7f26908fa340bb3a917cb1f0a57cf0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '923fba95ebf94eea99e5e044c91e7803', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6352ac453b95cc212a1ce38d4afef243ed9917a865dc723376a233fd72d4f2b8dd31d6ea7ab9c40f32080b3525ae09602707918d4c4ca7e7d560f99d720abad0', 'id': '5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'created_at': datetime.datetime(2026, 8, 1, 13, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bec3c73-6d7f-4bde-9ec7-87edb6976028/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Trying to clone 9718dcde-d89f-4b88-a3da-bb775965b474 from image 5bec3c73-6d7f-4bde-9ec7-87edb6976028 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:08:33 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Image download 0.00 MB at 0.00 MB/s Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f29d99-9e7c-4878-8b9b-42464b482b80]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:33 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD Aug 01 15:08:33 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7227c5d7-c210-4ec1-87bd-68e1d4ac01c1 tempest-VolumesExtendTest-245510205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7227c5d7-c210-4ec1-87bd-68e1d4ac01c1 tempest-VolumesExtendTest-245510205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc77dd-542a-405b-b5cb-fedb10bb415a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7227c5d7-c210-4ec1-87bd-68e1d4ac01c1 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:33 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:33 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 Aug 01 15:08:33 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:33 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD Aug 01 15:08:33 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:34 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7227c5d7-c210-4ec1-87bd-68e1d4ac01c1 tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409" returned: 0 in 0.544s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7227c5d7-c210-4ec1-87bd-68e1d4ac01c1 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d 2G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:34 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD" returned: 1 in 0.548s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:08:34 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Temporary image 5bec3c73-6d7f-4bde-9ec7-87edb6976028 is fetched for user fa7f9a12c077481c805ba466a2b2966b. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:08:34 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fd352f-718c-451e-96a5-afa20bcb28c0]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7227c5d7-c210-4ec1-87bd-68e1d4ac01c1 tempest-VolumesExtendTest-245510205 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d 2G" returned: 0 in 0.196s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7227c5d7-c210-4ec1-87bd-68e1d4ac01c1 tempest-VolumesExtendTest-245510205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.803s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:34 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7227c5d7-c210-4ec1-87bd-68e1d4ac01c1 tempest-VolumesExtendTest-245510205 None] Extend volume completed successfully. Aug 01 15:08:34 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD Aug 01 15:08:34 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:34 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:35 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD Aug 01 15:08:35 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Acquiring lock "cinder-5568e240-cfdf-44c6-8d73-639bfc9d392d-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Lock "cinder-5568e240-cfdf-44c6-8d73-639bfc9d392d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Acquiring lock "cinder-quobyte-559d4de0-7434-4874-81c6-8ba84bcd9409" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Lock "cinder-quobyte-559d4de0-7434-4874-81c6-8ba84bcd9409" acquired by "delete_snapshot" :: waited 0.048s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Acquiring lock "cinder-quobyte-5568e240-cfdf-44c6-8d73-639bfc9d392d" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Lock "cinder-quobyte-5568e240-cfdf-44c6-8d73-639bfc9d392d" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Deleting offline snapshot 5568e240-cfdf-44c6-8d73-639bfc9d392d of volume 559d4de0-7434-4874-81c6-8ba84bcd9409 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] snapshot_file for this snap is: volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ccaa38-7cf7-46a6-be49-61751dcb68e8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:35 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD" returned: 1 in 0.530s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9718dcde-d89f-4b88-a3da-bb775965b474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fba95ebf94eea99e5e044c91e7803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:33Z,use_quota=True,user_id='fa7f9a12c077481c805ba466a2b2966b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0b14829-3da1-404f-bd80-eb3ff7fc189b),volume_type_id=f0b14829-3da1-404f-bd80-eb3ff7fc189b)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Creating volume 9718dcde-d89f-4b88-a3da-bb775965b474 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:08:35 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:35 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 1073741824 Aug 01 15:08:35 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:35 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d Aug 01 15:08:35 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:35 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d" returned: 0 in 0.576s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-559d4de0-7434-4874-81c6-8ba84bcd9409(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0166c1-c2a3-4cce-a515-7e29ffcbf922]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:36 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 1073741824" returned: 0 in 0.745s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:36 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 Aug 01 15:08:36 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:36 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 Aug 01 15:08:36 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:36 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474" returned: 0 in 0.384s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:08:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:36 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Attempting download of 5bec3c73-6d7f-4bde-9ec7-87edb6976028 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'metadata': {}}])) to volume 9718dcde-d89f-4b88-a3da-bb775965b474. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:08:36 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:36 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7577fa49-7b8c-476e-8058-ca0115c355a3]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bec3c73-6d7f-4bde-9ec7-87edb6976028_9_28m4kh {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409" returned: 0 in 0.787s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:36 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d Aug 01 15:08:36 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:36 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bec3c73-6d7f-4bde-9ec7-87edb6976028_9_28m4kh Aug 01 15:08:36 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:37 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5bec3c73-6d7f-4bde-9ec7-87edb6976028_9_28m4kh" returned: 0 in 0.417s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bec3c73-6d7f-4bde-9ec7-87edb6976028_9_28m4kh {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:37 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bec3c73-6d7f-4bde-9ec7-87edb6976028_9_28m4kh Aug 01 15:08:37 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:37 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d" returned: 0 in 0.575s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:37 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d Aug 01 15:08:37 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:37 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=125,cinder:UPDATE=138,cinder:INSERT=45,cinder:DELETE=13 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bec3c73-6d7f-4bde-9ec7-87edb6976028_9_28m4kh" returned: 1 in 0.426s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5bec3c73-6d7f-4bde-9ec7-87edb6976028_9_28m4kh' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[33175989-0a59-4baa-bec1-703ae1acf78b]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=142,cinder:INSERT=44,cinder:SELECT=108,cinder:DELETE=9 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Flow 'volume_create_manager' (66b04da9-db13-4acf-9de1-9dae5e5363fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982bd9f8-ddae-4af8-8dfe-a65f63dfe756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:37 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409.5568e240-cfdf-44c6-8d73-639bfc9d392d" returned: 0 in 0.338s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982bd9f8-ddae-4af8-8dfe-a65f63dfe756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-35944619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fafee1a-c53a-4588-a3d1-d72993b8405e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69ca02562144ad1a20b90b21cdd2900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:38Z,use_quota=True,user_id='1e356cffb96c41908e474632708ac175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5a667e-6390-469f-acc5-0d8ec54ca9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5a667e-6390-469f-acc5-0d8ec54ca9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e4ffbd-3a58-495f-a023-40a5221e6506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e4ffbd-3a58-495f-a023-40a5221e6506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fafee1a-c53a-4588-a3d1-d72993b8405e', 'volume_name': 'volume-1fafee1a-c53a-4588-a3d1-d72993b8405e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c084b624-801c-466a-babb-48f5f0ff0859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c084b624-801c-466a-babb-48f5f0ff0859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:37 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD Aug 01 15:08:37 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d40c1d-ac84-46a5-a52f-1bd09a7759ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:37 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Volume 1fafee1a-c53a-4588-a3d1-d72993b8405e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fafee1a-c53a-4588-a3d1-d72993b8405e', 'volume_size': 1} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-35944619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fafee1a-c53a-4588-a3d1-d72993b8405e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69ca02562144ad1a20b90b21cdd2900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:38Z,use_quota=True,user_id='1e356cffb96c41908e474632708ac175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Creating volume 1fafee1a-c53a-4588-a3d1-d72993b8405e {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:08:37 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:37 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e 1073741824 Aug 01 15:08:37 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Lock "cinder-quobyte-5568e240-cfdf-44c6-8d73-639bfc9d392d" released by "_delete_snapshot" :: held 2.570s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Lock "cinder-quobyte-559d4de0-7434-4874-81c6-8ba84bcd9409" released by "delete_snapshot" :: held 2.624s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Created reservations ['785cb49e-69dd-4619-abd0-b4f69aaafa66', '6e0b4349-3f36-40b2-9d17-b6ddedb9898b', '7c6e4b76-cd91-4d44-9450-e9626134dcc0', '3a3b9c91-c9dc-4dee-ae9c-a887fe529e96'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:08:37 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Delete snapshot completed successfully. Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ba037-b548-43d1-979f-e1e8e3819492 tempest-VolumesExtendTest-245510205 None] Lock "cinder-5568e240-cfdf-44c6-8d73-639bfc9d392d-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:37 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:38 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD Aug 01 15:08:38 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:38 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e 1073741824" returned: 0 in 0.623s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:38 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD" returned: 1 in 0.439s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] 5bec3c73-6d7f-4bde-9ec7-87edb6976028 was raw, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:38 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 Aug 01 15:08:38 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Acquiring lock "cinder-559d4de0-7434-4874-81c6-8ba84bcd9409-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:08:38 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e Aug 01 15:08:38 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Flow 'volume_create_manager' (593e6c4a-b22c-4d29-99e3-e8503bfc4626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00696c0d-3e40-413f-86a7-f227bb02256f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Lock "cinder-559d4de0-7434-4874-81c6-8ba84bcd9409-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00696c0d-3e40-413f-86a7-f227bb02256f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-299022768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6a2c8e-58f6-4321-a424-4d80a0e15733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b6d8809acc4ee58046f437a40e937c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:38Z,use_quota=True,user_id='ff39e3419dab41bd8d3e1f7a19abfba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3cc1f1-0126-4f91-9d1c-08954510e684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3cc1f1-0126-4f91-9d1c-08954510e684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6349653c-f5d6-4476-8d08-7f0e5fa8103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6349653c-f5d6-4476-8d08-7f0e5fa8103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6a2c8e-58f6-4321-a424-4d80a0e15733', 'volume_name': 'volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbe239c-ae73-4425-95ef-440f5a467e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dbe239c-ae73-4425-95ef-440f5a467e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f2b971-1e35-4ccd-962b-bcd49b9ebad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:38 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Volume 4f6a2c8e-58f6-4321-a424-4d80a0e15733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733', 'volume_size': 1} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Acquiring lock "cinder-quobyte-559d4de0-7434-4874-81c6-8ba84bcd9409" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Lock "cinder-quobyte-559d4de0-7434-4874-81c6-8ba84bcd9409" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2017e009-f174-45b1-a6c0-2dc020e8a351]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:38 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e" returned: 0 in 0.316s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:38 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 Aug 01 15:08:38 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.199s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-299022768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6a2c8e-58f6-4321-a424-4d80a0e15733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b6d8809acc4ee58046f437a40e937c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:38Z,use_quota=True,user_id='ff39e3419dab41bd8d3e1f7a19abfba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Creating volume 4f6a2c8e-58f6-4321-a424-4d80a0e15733 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:08:38 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d40c1d-ac84-46a5-a52f-1bd09a7759ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fafee1a-c53a-4588-a3d1-d72993b8405e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf499c64-d59c-4101-862a-19c3ff71f9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:38 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733 1073741824 Aug 01 15:08:38 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:38 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Volume volume-1fafee1a-c53a-4588-a3d1-d72993b8405e (1fafee1a-c53a-4588-a3d1-d72993b8405e): created successfully Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf499c64-d59c-4101-862a-19c3ff71f9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Flow 'volume_create_manager' (66b04da9-db13-4acf-9de1-9dae5e5363fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:38 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-15c26052-11c5-4c1e-936d-896b813be8c9 tempest-VolumesActionsTest-1124923496 None] Created volume successfully. Aug 01 15:08:38 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474" returned: 0 in 0.505s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5bec3c73-6d7f-4bde-9ec7-87edb6976028_g2beq3iudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:08:38 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Converted 0.00 MB image at 0.00 MB/s Aug 01 15:08:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:38 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 1G Aug 01 15:08:38 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:39 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409" returned: 0 in 0.394s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:39 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409 Aug 01 15:08:39 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:39 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733 1073741824" returned: 0 in 0.451s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:39 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 1G" returned: 0 in 0.372s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Downloaded image 5bec3c73-6d7f-4bde-9ec7-87edb6976028 ((None, [{'url': 'file:///opt/stack/data/glance/images/5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'metadata': {}}])) to volume 9718dcde-d89f-4b88-a3da-bb775965b474 successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Temporary image 5bec3c73-6d7f-4bde-9ec7-87edb6976028 for user fa7f9a12c077481c805ba466a2b2966b is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Marking volume 9718dcde-d89f-4b88-a3da-bb775965b474 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:08:39 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733 Aug 01 15:08:39 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Copying metadata from image 5bec3c73-6d7f-4bde-9ec7-87edb6976028 to 9718dcde-d89f-4b88-a3da-bb775965b474. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Creating volume glance metadata for volume 9718dcde-d89f-4b88-a3da-bb775965b474 backed by image 5bec3c73-6d7f-4bde-9ec7-87edb6976028 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8f7f26908fa340bb3a917cb1f0a57cf0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:08:39 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559d4de0-7434-4874-81c6-8ba84bcd9409" returned: 0 in 0.317s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Lock "cinder-quobyte-559d4de0-7434-4874-81c6-8ba84bcd9409" released by "delete_volume" :: held 0.780s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9588c84d-b972-446f-9285-38a35042d726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9718dcde-d89f-4b88-a3da-bb775965b474', 'volume_size': 1, 'image_id': '5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f7f26908fa340bb3a917cb1f0a57cf0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '923fba95ebf94eea99e5e044c91e7803', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6352ac453b95cc212a1ce38d4afef243ed9917a865dc723376a233fd72d4f2b8dd31d6ea7ab9c40f32080b3525ae09602707918d4c4ca7e7d560f99d720abad0', 'id': '5bec3c73-6d7f-4bde-9ec7-87edb6976028', 'created_at': datetime.datetime(2026, 8, 1, 13, 8, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 8, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5bec3c73-6d7f-4bde-9ec7-87edb6976028/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3f20a2-5b5e-49a3-9c08-74a9673cf837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:39 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Volume volume-9718dcde-d89f-4b88-a3da-bb775965b474 (9718dcde-d89f-4b88-a3da-bb775965b474): created successfully Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3f20a2-5b5e-49a3-9c08-74a9673cf837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Flow 'volume_create_manager' (f3915373-0d05-461e-b1aa-8ce9e7a73ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:39 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-158b5fe7-6163-4509-af3a-9ae53e280f4b tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Created volume successfully. Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Created reservations ['f0c895b4-3b71-42d2-b64d-8f40efa8de80', '3aaeccb2-5abc-4461-b345-a2aa0232753a', '9651423a-b590-4243-8fe2-7a958144f9ae', '938c11f4-a07e-4cb0-b299-528a8607a3ae'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:08:39 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733" returned: 0 in 0.265s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f2b971-1e35-4ccd-962b-bcd49b9ebad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c46ff1-a686-4872-938d-1392f6e25e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:39 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:08:39 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:39 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Volume volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733 (4f6a2c8e-58f6-4321-a424-4d80a0e15733): created successfully Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c46ff1-a686-4872-938d-1392f6e25e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Flow 'volume_create_manager' (593e6c4a-b22c-4d29-99e3-e8503bfc4626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:39 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f613937b-cabb-4cc0-b307-ccd03f353f38 tempest-AttachVolumeNegativeTest-1581032568 None] Created volume successfully. Aug 01 15:08:39 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.318s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:08:39 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Deleted volume successfully. Aug 01 15:08:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-86a63c82-908a-4f8c-8589-c2852badc82e tempest-VolumesExtendTest-245510205 None] Lock "cinder-559d4de0-7434-4874-81c6-8ba84bcd9409-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Acquiring lock "cinder-9718dcde-d89f-4b88-a3da-bb775965b474-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Lock "cinder-9718dcde-d89f-4b88-a3da-bb775965b474-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Acquiring lock "cinder-quobyte-9718dcde-d89f-4b88-a3da-bb775965b474" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Lock "cinder-quobyte-9718dcde-d89f-4b88-a3da-bb775965b474" acquired by "delete_volume" :: waited 0.041s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:40 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24940f3-e85c-47cb-aec4-7aae36708b88]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:40 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 Aug 01 15:08:40 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:41 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474" returned: 0 in 0.629s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:41 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474 Aug 01 15:08:41 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:41 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9718dcde-d89f-4b88-a3da-bb775965b474" returned: 0 in 0.329s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Lock "cinder-quobyte-9718dcde-d89f-4b88-a3da-bb775965b474" released by "delete_volume" :: held 1.044s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-3cc321e6-40ee-4aa1-b5e5-938ea3960a9f req-460d83e7-7324-4445-acea-932c34cbc6e0 tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-3cc321e6-40ee-4aa1-b5e5-938ea3960a9f req-460d83e7-7324-4445-acea-932c34cbc6e0 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-3cc321e6-40ee-4aa1-b5e5-938ea3960a9f req-460d83e7-7324-4445-acea-932c34cbc6e0 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:41 devstack cinder-volume[89024]: WARNING cinder.quota [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:08:41 devstack cinder-volume[89024]: WARNING cinder.quota [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Created reservations ['b93ec7e7-3d32-4f67-9209-85ad26492228', 'b3fb0c9d-3ce3-4840-8963-b46e4aea5af0', '072bdeda-e04b-47db-8845-a8f8d91c4b02', '97efd2ca-4199-4b8c-a076-f692b4fbd0b7'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-3cc321e6-40ee-4aa1-b5e5-938ea3960a9f req-460d83e7-7324-4445-acea-932c34cbc6e0 tempest-AttachVolumeNegativeTest-1581032568 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1fb673f-810e-4d5f-8af7-a8893603cf41', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:08:41 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-3cc321e6-40ee-4aa1-b5e5-938ea3960a9f req-460d83e7-7324-4445-acea-932c34cbc6e0 tempest-AttachVolumeNegativeTest-1581032568 None] attachment_update completed successfully. Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:41 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:08:41 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:42 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.423s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:42 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:08:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Deleted volume successfully. Aug 01 15:08:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3495dcd6-7f43-40e1-af53-d75ce8e20c73 tempest-VolumeAndVolumeTypeFromImageTest-2042908585 None] Lock "cinder-9718dcde-d89f-4b88-a3da-bb775965b474-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:44 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-b0b7352f-0944-4d87-a00d-b0cb3af9143b req-23bdd6a3-4a2a-4b2b-8b55-796c589808a4 tempest-AttachVolumeNegativeTest-1581032568 None] Terminate volume connection completed successfully. Aug 01 15:08:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-b0b7352f-0944-4d87-a00d-b0cb3af9143b req-23bdd6a3-4a2a-4b2b-8b55-796c589808a4 tempest-AttachVolumeNegativeTest-1581032568 None] Deleting attachment e1fb673f-810e-4d5f-8af7-a8893603cf41. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Flow 'volume_create_manager' (33acbb24-60f5-44c6-9d6c-ef3ee6160964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cdc13f-f61c-4190-b84d-2669c58d3e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cdc13f-f61c-4190-b84d-2669c58d3e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-203896005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff3e22e-557b-434c-8e80-37e355a225ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b0f2030eb14070a698d5e27368dadc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:49Z,use_quota=True,user_id='7bc46141fd54410893e083a1c68dc149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c81ca71-68cf-4d67-87b8-45beb078995e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c81ca71-68cf-4d67-87b8-45beb078995e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626816ab-99b9-47cc-a02b-3228ee6e7d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626816ab-99b9-47cc-a02b-3228ee6e7d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff3e22e-557b-434c-8e80-37e355a225ea', 'volume_name': 'volume-fff3e22e-557b-434c-8e80-37e355a225ea', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e6ff7a-f28f-4b18-8a6f-95af73da687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e6ff7a-f28f-4b18-8a6f-95af73da687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f70c36-b41c-4cca-9b1b-c3144dbd10d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:48 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Volume fff3e22e-557b-434c-8e80-37e355a225ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff3e22e-557b-434c-8e80-37e355a225ea', 'volume_size': 1} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-203896005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff3e22e-557b-434c-8e80-37e355a225ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b0f2030eb14070a698d5e27368dadc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:49Z,use_quota=True,user_id='7bc46141fd54410893e083a1c68dc149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Creating volume fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:08:48 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:08:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:49 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea 1073741824 Aug 01 15:08:49 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:50 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea 1073741824" returned: 0 in 1.073s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:50 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea Aug 01 15:08:50 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:50 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea" returned: 0 in 0.409s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:08:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f70c36-b41c-4cca-9b1b-c3144dbd10d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff3e22e-557b-434c-8e80-37e355a225ea', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca157ff-1b17-4882-a444-20b609172898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:50 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Volume volume-fff3e22e-557b-434c-8e80-37e355a225ea (fff3e22e-557b-434c-8e80-37e355a225ea): created successfully Aug 01 15:08:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca157ff-1b17-4882-a444-20b609172898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Flow 'volume_create_manager' (33acbb24-60f5-44c6-9d6c-ef3ee6160964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b3cb9b30-f765-4b4f-ba78-d8176e6cade6 tempest-VolumesSnapshotListTestJSON-475448207 None] Created volume successfully. Aug 01 15:08:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] Creating offline snapshot da22a622-27e9-46cc-bd6a-7cf93c18014f of volume fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:08:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0291910-9a5e-4b59-9c5e-740648641179]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:51 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea Aug 01 15:08:51 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a8af36b2-a661-4fd1-83d3-0f671c53d243 tempest-VolumesActionsTest-1124923496 None] Acquiring lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e" by "attach_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a8af36b2-a661-4fd1-83d3-0f671c53d243 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e" acquired by "attach_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a8af36b2-a661-4fd1-83d3-0f671c53d243 tempest-VolumesActionsTest-1124923496 None] Attaching volume 1fafee1a-c53a-4588-a3d1-d72993b8405e to instance 80d3f852-dfc7-4f55-aadf-61553c70b26e at mountpoint /dev/vdb on host None. Aug 01 15:08:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a8af36b2-a661-4fd1-83d3-0f671c53d243 tempest-VolumesActionsTest-1124923496 None] Attach volume completed successfully. Aug 01 15:08:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a8af36b2-a661-4fd1-83d3-0f671c53d243 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e" released by "attach_volume" :: held 0.137s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1bef5e5-f9c3-4718-b6ac-dcf105887498 tempest-VolumesActionsTest-1124923496 None] Acquiring lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e-detach_volume" by "detach_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1bef5e5-f9c3-4718-b6ac-dcf105887498 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a1bef5e5-f9c3-4718-b6ac-dcf105887498 tempest-VolumesActionsTest-1124923496 None] Detaching volume 1fafee1a-c53a-4588-a3d1-d72993b8405e from instance 80d3f852-dfc7-4f55-aadf-61553c70b26e. Aug 01 15:08:52 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a1bef5e5-f9c3-4718-b6ac-dcf105887498 tempest-VolumesActionsTest-1124923496 None] Detach volume completed successfully. Aug 01 15:08:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea" returned: 0 in 0.854s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1bef5e5-f9c3-4718-b6ac-dcf105887498 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e-detach_volume" released by "detach_volume" :: held 0.251s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:52 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f 1G Aug 01 15:08:52 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:53 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f 1G" returned: 0 in 0.956s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff3e22e-557b-434c-8e80-37e355a225ea -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:53 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff3e22e-557b-434c-8e80-37e355a225ea -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f Aug 01 15:08:53 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:53 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff3e22e-557b-434c-8e80-37e355a225ea -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f" returned: 0 in 0.522s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:53 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f is being set with open permissions: ugo+rw Aug 01 15:08:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:53 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f Aug 01 15:08:53 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:54 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f" returned: 0 in 0.389s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:54 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.info Aug 01 15:08:54 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:54 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.info" returned: 0 in 0.411s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:54 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.info is being set with open permissions: ugo+rw Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:54 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.info Aug 01 15:08:54 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Flow 'volume_create_manager' (882756ad-8106-49c5-9d51-18a585de886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e28084d-f6df-410f-a051-4687233f9cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e28084d-f6df-410f-a051-4687233f9cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755734111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000cf035-1ee7-4d36-bdb9-97c98464cfce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb876d499d8447fc8335a73678781b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:55Z,use_quota=True,user_id='a61df7d44d5e49daa8a082901a360aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abc1c59-e719-4a23-8ffc-e3536b055e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abc1c59-e719-4a23-8ffc-e3536b055e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d821a6f4-1741-4714-bee8-aa1e7cec47bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d821a6f4-1741-4714-bee8-aa1e7cec47bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '000cf035-1ee7-4d36-bdb9-97c98464cfce', 'volume_name': 'volume-000cf035-1ee7-4d36-bdb9-97c98464cfce', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6091585-c6aa-43a5-ad18-159778cb2ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6091585-c6aa-43a5-ad18-159778cb2ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14281b59-a576-4a1c-b88b-e8bb5a2a215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:54 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Volume 000cf035-1ee7-4d36-bdb9-97c98464cfce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-000cf035-1ee7-4d36-bdb9-97c98464cfce', 'volume_size': 1} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:54 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.info" returned: 0 in 0.344s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.687s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755734111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000cf035-1ee7-4d36-bdb9-97c98464cfce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb876d499d8447fc8335a73678781b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:55Z,use_quota=True,user_id='a61df7d44d5e49daa8a082901a360aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Creating volume 000cf035-1ee7-4d36-bdb9-97c98464cfce {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:08:54 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:08:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7514bd18-0b5f-46da-ba09-59ea3ba6ba83 tempest-VolumesSnapshotListTestJSON-475448207 None] Create snapshot completed successfully Aug 01 15:08:55 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce 1073741824 Aug 01 15:08:55 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:55 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce 1073741824" returned: 0 in 0.543s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:55 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce Aug 01 15:08:55 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:55 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce" returned: 0 in 0.320s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.114s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14281b59-a576-4a1c-b88b-e8bb5a2a215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000cf035-1ee7-4d36-bdb9-97c98464cfce', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544b001b-0cef-4b8a-a5cb-bde53b685f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] Creating offline snapshot 73041956-cfe1-4468-9c66-749710d3544c of volume fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:08:55 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Volume volume-000cf035-1ee7-4d36-bdb9-97c98464cfce (000cf035-1ee7-4d36-bdb9-97c98464cfce): created successfully Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544b001b-0cef-4b8a-a5cb-bde53b685f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Flow 'volume_create_manager' (882756ad-8106-49c5-9d51-18a585de886c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed54eb00-9afd-4de1-82ea-1d952d19a1b4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ee4d81ad-009b-4cba-8760-b2b7de88654b tempest-ProjectReaderTests-1409528959 None] Created volume successfully. Aug 01 15:08:56 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f Aug 01 15:08:56 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:56 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f" returned: 0 in 0.448s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff3e22e-557b-434c-8e80-37e355a225ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:08:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:56 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c 1G Aug 01 15:08:56 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Acquiring lock "cinder-000cf035-1ee7-4d36-bdb9-97c98464cfce-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Lock "cinder-000cf035-1ee7-4d36-bdb9-97c98464cfce-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:57 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c 1G" returned: 0 in 0.726s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:57 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c Aug 01 15:08:57 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Acquiring lock "cinder-quobyte-000cf035-1ee7-4d36-bdb9-97c98464cfce" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Lock "cinder-quobyte-000cf035-1ee7-4d36-bdb9-97c98464cfce" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3632c112-aba2-44fc-aae3-0862a9e18faa]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:57 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce Aug 01 15:08:57 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:57 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c" returned: 0 in 0.429s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:57 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c is being set with open permissions: ugo+rw Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:57 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c Aug 01 15:08:57 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:57 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce" returned: 0 in 0.455s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:57 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce Aug 01 15:08:57 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:57 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c" returned: 0 in 0.333s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:58 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-07bf68ed-7b72-4a6b-963e-0afc660d1945 tempest-VolumesSnapshotListTestJSON-475448207 None] Create snapshot completed successfully Aug 01 15:08:58 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-000cf035-1ee7-4d36-bdb9-97c98464cfce" returned: 0 in 0.322s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Lock "cinder-quobyte-000cf035-1ee7-4d36-bdb9-97c98464cfce" released by "delete_volume" :: held 0.834s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Created reservations ['c981cf10-e08e-4a58-a002-92b4fe1d5354', '303dcfad-72b3-44b0-9f17-9819005fb7df', '5eea811b-e55d-48ab-8fc6-27739a93a236', '227eec3a-0ada-4ef5-8d64-10e3ae0a46a2'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:58 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:08:58 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:58 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.382s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:08:58 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Deleted volume successfully. Aug 01 15:08:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca609683-ae20-411c-bb80-f9aca9324d02 tempest-ProjectReaderTests-1409528959 None] Lock "cinder-000cf035-1ee7-4d36-bdb9-97c98464cfce-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Flow 'volume_create_manager' (bde479d9-cb44-41aa-893e-5d37ad342914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680e1af7-54af-4f7e-8460-e958dfdb32e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680e1af7-54af-4f7e-8460-e958dfdb32e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296268765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1618e1f4-a451-453d-a325-d47f66af333b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb876d499d8447fc8335a73678781b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:59Z,use_quota=True,user_id='a61df7d44d5e49daa8a082901a360aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7337ce1-ff68-47e7-b95e-1caffe2e70ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7337ce1-ff68-47e7-b95e-1caffe2e70ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579bc951-407b-47e9-b5d9-024d7b72efda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579bc951-407b-47e9-b5d9-024d7b72efda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1618e1f4-a451-453d-a325-d47f66af333b', 'volume_name': 'volume-1618e1f4-a451-453d-a325-d47f66af333b', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bbc2a9-d1d1-4caf-8e4d-244d4224a430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bbc2a9-d1d1-4caf-8e4d-244d4224a430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae5d2fb-6d41-464c-bebd-48d87a47b5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:08:59 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Volume 1618e1f4-a451-453d-a325-d47f66af333b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1618e1f4-a451-453d-a325-d47f66af333b', 'volume_size': 1} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296268765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1618e1f4-a451-453d-a325-d47f66af333b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb876d499d8447fc8335a73678781b2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:08:59Z,use_quota=True,user_id='a61df7d44d5e49daa8a082901a360aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Creating volume 1618e1f4-a451-453d-a325-d47f66af333b {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:08:59 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:08:59 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b 1073741824 Aug 01 15:08:59 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:08:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:00 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b 1073741824" returned: 0 in 0.692s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:00 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b Aug 01 15:09:00 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:00 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b" returned: 0 in 0.341s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.027s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] Creating offline snapshot 43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 of volume fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae5d2fb-6d41-464c-bebd-48d87a47b5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1618e1f4-a451-453d-a325-d47f66af333b', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0aaf568-a09f-4270-b83c-8f1403741428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82b4ef9-09c7-4e57-b96c-9fdc90ce3c84]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:00 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Volume volume-1618e1f4-a451-453d-a325-d47f66af333b (1618e1f4-a451-453d-a325-d47f66af333b): created successfully Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0aaf568-a09f-4270-b83c-8f1403741428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Flow 'volume_create_manager' (bde479d9-cb44-41aa-893e-5d37ad342914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:09:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b9f28cad-651c-42ca-9040-8eeaba515f7e tempest-ProjectReaderTests-1409528959 None] Created volume successfully. Aug 01 15:09:00 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c Aug 01 15:09:00 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:01 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c" returned: 0 in 0.453s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff3e22e-557b-434c-8e80-37e355a225ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:09:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:01 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 1G Aug 01 15:09:01 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Acquiring lock "cinder-1618e1f4-a451-453d-a325-d47f66af333b-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Lock "cinder-1618e1f4-a451-453d-a325-d47f66af333b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Acquiring lock "cinder-quobyte-1618e1f4-a451-453d-a325-d47f66af333b" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Lock "cinder-quobyte-1618e1f4-a451-453d-a325-d47f66af333b" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:01 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f6bf49-be53-455e-8324-2cf239badc59]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:01 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b Aug 01 15:09:01 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:01 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 1G" returned: 0 in 0.756s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:01 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 Aug 01 15:09:01 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:02 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b" returned: 0 in 0.554s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:02 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b Aug 01 15:09:02 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:02 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5" returned: 0 in 0.380s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:02 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 is being set with open permissions: ugo+rw Aug 01 15:09:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:02 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 Aug 01 15:09:02 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:02 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1618e1f4-a451-453d-a325-d47f66af333b" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Lock "cinder-quobyte-1618e1f4-a451-453d-a325-d47f66af333b" released by "delete_volume" :: held 0.976s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:02 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Created reservations ['c1069af5-ac06-4f10-8f0a-7c6b75ca1cde', 'a3c24915-30c4-440d-90fe-e804002f7ddb', '550ce373-44f5-4201-a29c-eb55efd62cfe', '03053036-fb2b-41e6-bf71-a9121bffb08e'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:09:02 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5" returned: 0 in 0.506s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4cc112e7-a3f7-4909-86c3-c27c9333d031 tempest-VolumesSnapshotListTestJSON-475448207 None] Create snapshot completed successfully Aug 01 15:09:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:09:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:09:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:03 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:09:03 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:03 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.449s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:03 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:09:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Deleted volume successfully. Aug 01 15:09:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a58e03b3-0b72-41ba-b4f1-5e4d375527f8 tempest-ProjectReaderTests-1409528959 None] Lock "cinder-1618e1f4-a451-453d-a325-d47f66af333b-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "cinder-43e06a30-cceb-479e-a7d6-d3cd30c6b5e5-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-43e06a30-cceb-479e-a7d6-d3cd30c6b5e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "cinder-quobyte-43e06a30-cceb-479e-a7d6-d3cd30c6b5e5" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-43e06a30-cceb-479e-a7d6-d3cd30c6b5e5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Deleting offline snapshot 43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 of volume fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] snapshot_file for this snap is: volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62a71b3-4634-410f-b16b-b8f572b6a6cf]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:05 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 Aug 01 15:09:05 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:05 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5" returned: 0 in 0.455s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff3e22e-557b-434c-8e80-37e355a225ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[024cc16a-f987-44da-80fb-fe1a5d177640]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:05 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c Aug 01 15:09:05 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:06 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c" returned: 0 in 0.573s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff3e22e-557b-434c-8e80-37e355a225ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:09:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:06 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 Aug 01 15:09:06 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:07 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5" returned: 0 in 0.744s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:07 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5 Aug 01 15:09:07 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:08 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.43e06a30-cceb-479e-a7d6-d3cd30c6b5e5" returned: 0 in 0.966s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-43e06a30-cceb-479e-a7d6-d3cd30c6b5e5" released by "_delete_snapshot" :: held 2.956s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" released by "delete_snapshot" :: held 3.001s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:08 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Created reservations ['d7fd8b86-6aa1-4b1a-8fcd-fc75b983f28f', 'd28f493d-1b8b-497c-8732-c2b20f1b7a9c', '3f1c1512-4abc-4960-a998-ad4fa8ac164a', '7d2ebdd0-7ef0-4fde-9cc1-42f658c3fa42'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:09:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-185a52fa-2bec-4721-a141-8c61a3922766 tempest-VolumesActionsTest-1124923496 None] Acquiring lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e" by "attach_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-185a52fa-2bec-4721-a141-8c61a3922766 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e" acquired by "attach_volume" :: waited 0.041s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Delete snapshot completed successfully. Aug 01 15:09:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2a246e9c-606f-433a-b8b6-8daee576b0e6 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-43e06a30-cceb-479e-a7d6-d3cd30c6b5e5-delete_snapshot" released by "delete_snapshot" :: held 3.534s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-185a52fa-2bec-4721-a141-8c61a3922766 tempest-VolumesActionsTest-1124923496 None] Attaching volume 1fafee1a-c53a-4588-a3d1-d72993b8405e to instance 035de609-0f4a-421f-80cd-8cc9e056ee60 at mountpoint /dev/vdb on host None. Aug 01 15:09:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-185a52fa-2bec-4721-a141-8c61a3922766 tempest-VolumesActionsTest-1124923496 None] Attach volume completed successfully. Aug 01 15:09:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-185a52fa-2bec-4721-a141-8c61a3922766 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e" released by "attach_volume" :: held 0.233s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5d60edc7-d9ce-4528-8b70-2d59210f41b6 tempest-VolumesActionsTest-1124923496 None] Acquiring lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e-detach_volume" by "detach_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5d60edc7-d9ce-4528-8b70-2d59210f41b6 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5d60edc7-d9ce-4528-8b70-2d59210f41b6 tempest-VolumesActionsTest-1124923496 None] Detaching volume 1fafee1a-c53a-4588-a3d1-d72993b8405e from instance 035de609-0f4a-421f-80cd-8cc9e056ee60. Aug 01 15:09:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5d60edc7-d9ce-4528-8b70-2d59210f41b6 tempest-VolumesActionsTest-1124923496 None] Detach volume completed successfully. Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5d60edc7-d9ce-4528-8b70-2d59210f41b6 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "cinder-73041956-cfe1-4468-9c66-749710d3544c-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-73041956-cfe1-4468-9c66-749710d3544c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" acquired by "delete_snapshot" :: waited 0.041s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "cinder-quobyte-73041956-cfe1-4468-9c66-749710d3544c" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-73041956-cfe1-4468-9c66-749710d3544c" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Deleting offline snapshot 73041956-cfe1-4468-9c66-749710d3544c of volume fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] snapshot_file for this snap is: volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe463da-2fe0-43cb-af51-b4c9cd73749b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:10 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c Aug 01 15:09:10 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:10 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c" returned: 0 in 0.819s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff3e22e-557b-434c-8e80-37e355a225ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:09:10 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04da527-7c58-42e5-af13-3941bc90cc13]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:11 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f Aug 01 15:09:11 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:11 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f" returned: 0 in 0.771s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff3e22e-557b-434c-8e80-37e355a225ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:09:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:11 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c Aug 01 15:09:11 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:12 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c" returned: 0 in 0.838s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:12 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c Aug 01 15:09:12 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:12 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.73041956-cfe1-4468-9c66-749710d3544c" returned: 0 in 0.444s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-73041956-cfe1-4468-9c66-749710d3544c" released by "_delete_snapshot" :: held 3.087s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" released by "delete_snapshot" :: held 3.145s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:13 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Created reservations ['fa5f9681-ec5b-4d1a-854f-7240b955d742', 'cf346793-2e43-4f4a-ba48-024a1fd2ffb6', 'ff290445-33ab-4f5f-ae00-70b3a181c232', '2b4ac4dd-76e5-4a26-a1d3-f177bc2c9062'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:09:13 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Delete snapshot completed successfully. Aug 01 15:09:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f5db142e-f895-48f3-9c83-3b79b4eb7cfa tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-73041956-cfe1-4468-9c66-749710d3544c-delete_snapshot" released by "delete_snapshot" :: held 3.549s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "cinder-da22a622-27e9-46cc-bd6a-7cf93c18014f-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-da22a622-27e9-46cc-bd6a-7cf93c18014f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" acquired by "delete_snapshot" :: waited 0.039s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "cinder-quobyte-da22a622-27e9-46cc-bd6a-7cf93c18014f" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-da22a622-27e9-46cc-bd6a-7cf93c18014f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Deleting offline snapshot da22a622-27e9-46cc-bd6a-7cf93c18014f of volume fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] snapshot_file for this snap is: volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb63f84c-5c22-46d4-b38a-80ba58027cf1]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:14 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f Aug 01 15:09:14 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:14 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f" returned: 0 in 0.607s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff3e22e-557b-434c-8e80-37e355a225ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb76cb5-45c2-4a4b-a04d-b2325aff1c2f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:15 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea Aug 01 15:09:15 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:15 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea" returned: 0 in 0.623s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:15 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f Aug 01 15:09:15 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:16 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f" returned: 0 in 0.569s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:16 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f Aug 01 15:09:16 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:16 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea.da22a622-27e9-46cc-bd6a-7cf93c18014f" returned: 0 in 0.278s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-da22a622-27e9-46cc-bd6a-7cf93c18014f" released by "_delete_snapshot" :: held 2.222s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" released by "delete_snapshot" :: held 2.261s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:16 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Created reservations ['314b491a-9824-49c3-b9b7-5c31bb30a2c3', 'b06d67a6-eaee-418f-8952-ade83fcf5d1b', 'e59775d9-8c79-44f2-b0a5-c95a6a282b0c', '60475d35-86e5-4a7f-a249-1eeb8d82232d'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:09:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:16 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Delete snapshot completed successfully. Aug 01 15:09:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c839acb5-ef29-4739-bcbe-a91c2355ae61 tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-da22a622-27e9-46cc-bd6a-7cf93c18014f-delete_snapshot" released by "delete_snapshot" :: held 2.483s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:16 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c5c6c0-8353-4a68-966c-6bc973588c27]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:16 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e Aug 01 15:09:16 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:17 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e" returned: 0 in 0.386s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:17 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99edf16-6ab4-4a9a-b7d3-02d5f6287472]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:17 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e Aug 01 15:09:17 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:17 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e" returned: 0 in 0.381s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.9b957010-099f-47ef-b4ea-0c0fd71c4e31guh34_u0.img {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:17 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.9b957010-099f-47ef-b4ea-0c0fd71c4e31guh34_u0.img Aug 01 15:09:17 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "cinder-fff3e22e-557b-434c-8e80-37e355a225ea-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-fff3e22e-557b-434c-8e80-37e355a225ea-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:17 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9691fa-32e9-4f2b-92ce-cd264b61928b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:17 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea Aug 01 15:09:17 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:09:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:09:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:09:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:18 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:09:18 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:18 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea" returned: 0 in 1.232s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:19 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea Aug 01 15:09:19 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:19 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.847s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:09:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:09:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:09:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:09:19 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fff3e22e-557b-434c-8e80-37e355a225ea" returned: 0 in 0.848s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-quobyte-fff3e22e-557b-434c-8e80-37e355a225ea" released by "delete_volume" :: held 2.182s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:20 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Created reservations ['05f25822-65ed-440e-8cee-82bda2f4b52f', '63bea946-5fd9-4745-94cf-3dd6e4f46b15', '0656941d-3f14-4480-a47a-eb9a3d41f63b', '06c197ec-5a1b-46fc-99cb-d91a0c8a2270'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:09:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:09:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:09:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:20 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:09:20 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:21 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.686s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:21 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:09:21 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Deleted volume successfully. Aug 01 15:09:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-de485f6f-d823-47e8-aa44-5aa6a0e4510b tempest-VolumesSnapshotListTestJSON-475448207 None] Lock "cinder-fff3e22e-557b-434c-8e80-37e355a225ea-delete_volume" released by "delete_volume" :: held 3.586s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:22 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.9b957010-099f-47ef-b4ea-0c0fd71c4e31guh34_u0.img" returned: 0 in 5.337s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:22 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[856219d0-55fb-498f-95d7-1a5d9716e19a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:22 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e Aug 01 15:09:22 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:23 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e" returned: 0 in 0.572s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:23 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.9b957010-099f-47ef-b4ea-0c0fd71c4e31guh34_u0.img {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:09:23 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] Converted 1024.00 MB image at 191.83 MB/s Aug 01 15:09:23 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] 9b957010-099f-47ef-b4ea-0c0fd71c4e31 was raw, no need to convert to raw {{(pid=89024) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1170}} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Flow 'volume_create_manager' (80a45688-89f4-4212-b2e9-18da181878da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc203b19-a291-4a33-9702-8d09f5e10d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc203b19-a291-4a33-9702-8d09f5e10d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-34904650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7601b74d-525a-48c1-81c3-54e99ae18b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b6d8809acc4ee58046f437a40e937c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:09:32Z,use_quota=True,user_id='ff39e3419dab41bd8d3e1f7a19abfba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45902bd-d798-4308-b1b9-1897a8e5666f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45902bd-d798-4308-b1b9-1897a8e5666f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a0457e-8855-4a72-9fa9-055e7ce8eb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a0457e-8855-4a72-9fa9-055e7ce8eb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7601b74d-525a-48c1-81c3-54e99ae18b0f', 'volume_name': 'volume-7601b74d-525a-48c1-81c3-54e99ae18b0f', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253071ee-4e92-4eff-86b5-e62cc66ee3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253071ee-4e92-4eff-86b5-e62cc66ee3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f605f671-2adb-4e1e-a9f8-f217bc7bea2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:32 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Volume 7601b74d-525a-48c1-81c3-54e99ae18b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7601b74d-525a-48c1-81c3-54e99ae18b0f', 'volume_size': 1} Aug 01 15:09:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:42 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=90,cinder:INSERT=30,cinder:UPDATE=97,cinder:DELETE=7 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:09:42 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=93,cinder:INSERT=25,cinder:UPDATE=84,cinder:DELETE=7 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.412s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] Uploaded volume to glance image-id: 9b957010-099f-47ef-b4ea-0c0fd71c4e31. {{(pid=89024) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.806s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-34904650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7601b74d-525a-48c1-81c3-54e99ae18b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b6d8809acc4ee58046f437a40e937c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:09:32Z,use_quota=True,user_id='ff39e3419dab41bd8d3e1f7a19abfba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Creating volume 7601b74d-525a-48c1-81c3-54e99ae18b0f {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:09:46 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:46 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f 1073741824 Aug 01 15:09:46 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:46 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-10bbd94f-3396-4dea-9628-207716a22146 tempest-VolumesActionsTest-1124923496 None] Copy volume to image completed successfully. Aug 01 15:09:46 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f 1073741824" returned: 0 in 0.625s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:46 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f Aug 01 15:09:46 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:47 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f" returned: 0 in 0.306s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f605f671-2adb-4e1e-a9f8-f217bc7bea2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7601b74d-525a-48c1-81c3-54e99ae18b0f', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c512e79b-d683-4e2e-9ad2-a2214420c42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Volume volume-7601b74d-525a-48c1-81c3-54e99ae18b0f (7601b74d-525a-48c1-81c3-54e99ae18b0f): created successfully Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c512e79b-d683-4e2e-9ad2-a2214420c42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Flow 'volume_create_manager' (80a45688-89f4-4212-b2e9-18da181878da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:09:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-171a051f-e144-4f32-bf54-58ec7a840c27 tempest-AttachVolumeNegativeTest-1581032568 None] Created volume successfully. Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Flow 'volume_create_manager' (6835119a-d98e-466c-bd58-cd9b571274b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd6f1ac-3d85-4e53-9be5-9146667144e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd6f1ac-3d85-4e53-9be5-9146667144e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1375760979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29246531-8f54-4ded-a0cd-de44698ae631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455a4549a97b4464b4896818f5701397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:09:47Z,use_quota=True,user_id='d37ecc5e42da4b088c5ae76fcd8df4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a722dc-c75c-4699-b8f0-2ce9f0c78a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a722dc-c75c-4699-b8f0-2ce9f0c78a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2c943d-6c8f-4c5e-a523-6e2d71127e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2c943d-6c8f-4c5e-a523-6e2d71127e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29246531-8f54-4ded-a0cd-de44698ae631', 'volume_name': 'volume-29246531-8f54-4ded-a0cd-de44698ae631', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d29791-3f28-4b38-863c-840ba826ff45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d29791-3f28-4b38-863c-840ba826ff45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948b2e12-1b82-4a47-a595-a13fc028445c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Volume 29246531-8f54-4ded-a0cd-de44698ae631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29246531-8f54-4ded-a0cd-de44698ae631', 'volume_size': 1} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1375760979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29246531-8f54-4ded-a0cd-de44698ae631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='455a4549a97b4464b4896818f5701397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:09:47Z,use_quota=True,user_id='d37ecc5e42da4b088c5ae76fcd8df4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Creating volume 29246531-8f54-4ded-a0cd-de44698ae631 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:09:47 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:47 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 1073741824 Aug 01 15:09:47 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:47 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 1073741824" returned: 0 in 0.498s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:47 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 Aug 01 15:09:47 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c85d4f9d-259b-4d88-b119-d08d09b998a6 req-9baf82bb-9ae8-436b-a1c3-06441257a2e2 tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:48 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631" returned: 0 in 0.254s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.774s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (948b2e12-1b82-4a47-a595-a13fc028445c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29246531-8f54-4ded-a0cd-de44698ae631', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563fbff9-d55f-4ba3-bb2d-7ef73942a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8a1a7c-ad7d-452b-b16c-dee4b1a9d30b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:48 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Volume volume-29246531-8f54-4ded-a0cd-de44698ae631 (29246531-8f54-4ded-a0cd-de44698ae631): created successfully Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563fbff9-d55f-4ba3-bb2d-7ef73942a970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Flow 'volume_create_manager' (6835119a-d98e-466c-bd58-cd9b571274b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:09:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6a61f907-2008-4a8e-a058-ae91ce899c01 tempest-TestImageHashVerification-753930806 None] Created volume successfully. Aug 01 15:09:48 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e Aug 01 15:09:48 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:48 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e" returned: 0 in 0.368s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[45101227-ee25-4925-a782-fa824548ace9]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:48 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e Aug 01 15:09:48 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:48 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e" returned: 0 in 0.357s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:48 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img Aug 01 15:09:48 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:53 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img" returned: 0 in 4.654s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:53 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[221966b9-ebc0-42b9-9538-9d415b6bb3df]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:53 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e Aug 01 15:09:53 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:54 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e" returned: 0 in 0.517s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:54 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:09:54 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Converted 1024.00 MB image at 219.97 MB/s Aug 01 15:09:54 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] 2d38937a-af25-42de-ba4c-38ddfa0868b4 was raw, converting to qcow2 {{(pid=89024) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1187}} Aug 01 15:09:54 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e80cd5-8fcd-4f6e-aa85-e79acf1a6b92]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:54 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img Aug 01 15:09:54 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:54 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img" returned: 0 in 0.327s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:54 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img Aug 01 15:09:54 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:54 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img" returned: 1 in 0.321s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:09:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img /opt/stack/data/cinder/conversion/vol_upload__bw0iecc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:54 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img /opt/stack/data/cinder/conversion/vol_upload__bw0iecc Aug 01 15:09:54 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:55 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img /opt/stack/data/cinder/conversion/vol_upload__bw0iecc" returned: 0 in 0.262s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:55 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Image conversion details: src /opt/stack/data/cinder/conversion/1fafee1a-c53a-4588-a3d1-d72993b8405e.temp_image.2d38937a-af25-42de-ba4c-38ddfa0868b43dklo_s3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__bw0iecc {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:09:55 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 01 15:09:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db434e3-7d7a-480a-878c-753d633eae29]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__bw0iecc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:55 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__bw0iecc Aug 01 15:09:55 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:55 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__bw0iecc" returned: 0 in 0.322s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.456s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Uploaded volume to glance image-id: 2d38937a-af25-42de-ba4c-38ddfa0868b4. {{(pid=89024) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 01 15:09:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c85d4f9d-259b-4d88-b119-d08d09b998a6 req-9baf82bb-9ae8-436b-a1c3-06441257a2e2 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.628s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c85d4f9d-259b-4d88-b119-d08d09b998a6 req-9baf82bb-9ae8-436b-a1c3-06441257a2e2 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.150s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ddd8955e-6cfa-4d90-9125-9ff9f4aecc87 tempest-VolumesActionsTest-1124923496 None] Copy volume to image completed successfully. Aug 01 15:09:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e3f53-a355-4d68-a182-da85622c2391]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c85d4f9d-259b-4d88-b119-d08d09b998a6 req-9baf82bb-9ae8-436b-a1c3-06441257a2e2 tempest-AttachVolumeNegativeTest-1581032568 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-7601b74d-525a-48c1-81c3-54e99ae18b0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07f11881-a58c-4d1f-83f2-f9ed59879072', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:09:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-c85d4f9d-259b-4d88-b119-d08d09b998a6 req-9baf82bb-9ae8-436b-a1c3-06441257a2e2 tempest-AttachVolumeNegativeTest-1581032568 None] attachment_update completed successfully. Aug 01 15:09:56 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 Aug 01 15:09:56 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:57 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631" returned: 0 in 0.415s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b876c-8bf5-4098-8154-1062438cc171]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:57 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 Aug 01 15:09:57 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:57 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631" returned: 0 in 0.448s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 /opt/stack/data/cinder/conversion/29246531-8f54-4ded-a0cd-de44698ae631.temp_image.5ab7bab8-f1da-440d-a8d9-8c5ce0e312038gfmy8hf.img {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:57 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 /opt/stack/data/cinder/conversion/29246531-8f54-4ded-a0cd-de44698ae631.temp_image.5ab7bab8-f1da-440d-a8d9-8c5ce0e312038gfmy8hf.img Aug 01 15:09:57 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Acquiring lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Acquiring lock "cinder-quobyte-1fafee1a-c53a-4588-a3d1-d72993b8405e" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:09:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-quobyte-1fafee1a-c53a-4588-a3d1-d72993b8405e" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:09:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a6c7e2-0d00-4619-acb0-2fb138551f94]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:09:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:57 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e Aug 01 15:09:57 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:58 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e" returned: 0 in 0.867s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:58 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e Aug 01 15:09:58 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:09:59 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Aug 01 15:09:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1fafee1a-c53a-4588-a3d1-d72993b8405e" returned: 0 in 0.549s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:09:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-quobyte-1fafee1a-c53a-4588-a3d1-d72993b8405e" released by "delete_volume" :: held 1.502s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:09:59 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Created reservations ['0785534a-2f41-4567-9825-4fb6494f47b5', 'fc7cb661-c23b-4d0f-a2ba-804cf5078f65', '25568bf5-5591-49fc-80e0-b51c8ce4130a', '29b4441f-6641-48cf-af93-605d7a4aa713'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:09:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:09:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:09:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:09:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:09:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:09:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:09:59 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:09:59 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:00 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.710s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:00 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:10:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Deleted volume successfully. Aug 01 15:10:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2e963aa-7a68-4459-ade5-d873aa2636e5 tempest-VolumesActionsTest-1124923496 None] Lock "cinder-1fafee1a-c53a-4588-a3d1-d72993b8405e-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-28d043ad-0380-4876-b4b3-3691d343308e req-fe44771c-7af7-4fea-95b6-74117090ff95 tempest-AttachVolumeNegativeTest-1581032568 None] Terminate volume connection completed successfully. Aug 01 15:10:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-28d043ad-0380-4876-b4b3-3691d343308e req-fe44771c-7af7-4fea-95b6-74117090ff95 tempest-AttachVolumeNegativeTest-1581032568 None] Deleting attachment 07f11881-a58c-4d1f-83f2-f9ed59879072. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:10:02 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 /opt/stack/data/cinder/conversion/29246531-8f54-4ded-a0cd-de44698ae631.temp_image.5ab7bab8-f1da-440d-a8d9-8c5ce0e312038gfmy8hf.img" returned: 0 in 5.313s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:02 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdfc980-3562-4739-af2d-ea26dcbe39e0]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:02 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 Aug 01 15:10:02 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:03 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631" returned: 0 in 0.701s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:03 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/conversion/29246531-8f54-4ded-a0cd-de44698ae631.temp_image.5ab7bab8-f1da-440d-a8d9-8c5ce0e312038gfmy8hf.img {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:10:03 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] Converted 1024.00 MB image at 192.69 MB/s Aug 01 15:10:03 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] 5ab7bab8-f1da-440d-a8d9-8c5ce0e31203 was raw, no need to convert to raw {{(pid=89024) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1170}} Aug 01 15:10:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "cinder-7601b74d-525a-48c1-81c3-54e99ae18b0f-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-7601b74d-525a-48c1-81c3-54e99ae18b0f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "cinder-quobyte-7601b74d-525a-48c1-81c3-54e99ae18b0f" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-quobyte-7601b74d-525a-48c1-81c3-54e99ae18b0f" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[52be3511-6c4a-4148-b520-6fb05827e95f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:07 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f Aug 01 15:10:07 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:08 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f" returned: 0 in 0.473s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:08 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f Aug 01 15:10:08 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:08 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7601b74d-525a-48c1-81c3-54e99ae18b0f" returned: 0 in 0.321s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-quobyte-7601b74d-525a-48c1-81c3-54e99ae18b0f" released by "delete_volume" :: held 0.847s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Created reservations ['c6149562-0aa8-4b79-b652-5decb603a62f', '29844815-474b-419a-be23-e78a2efce401', 'ebbe6aa1-3321-4183-ba16-f8db3d2a2520', 'bab4c195-2351-4525-8851-3f1c0b00df64'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:08 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:10:08 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "cinder-4f6a2c8e-58f6-4321-a424-4d80a0e15733-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-4f6a2c8e-58f6-4321-a424-4d80a0e15733-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:09 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.347s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:09 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:10:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "cinder-quobyte-4f6a2c8e-58f6-4321-a424-4d80a0e15733" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Deleted volume successfully. Aug 01 15:10:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-quobyte-4f6a2c8e-58f6-4321-a424-4d80a0e15733" acquired by "delete_volume" :: waited 0.052s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bfe2d9a4-cdc5-4b05-b07b-9edd4eefc3de tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-7601b74d-525a-48c1-81c3-54e99ae18b0f-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7060faf-9c56-4cd8-8cc7-8f4d1f534cd9]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:09 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733 Aug 01 15:10:09 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:09 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733" returned: 0 in 0.570s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:09 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733 Aug 01 15:10:09 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:09 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4f6a2c8e-58f6-4321-a424-4d80a0e15733" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-quobyte-4f6a2c8e-58f6-4321-a424-4d80a0e15733" released by "delete_volume" :: held 0.949s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:10 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Created reservations ['637e4bde-ac44-425b-ab1d-4d79a187487b', '69e09007-5a02-46c3-8a1c-90d254dea673', 'ef0141a8-a2f4-4cab-8b58-7700a3e49c22', 'b798786e-a4aa-4c25-9eed-b0816bdedf52'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:10:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:10 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:10:10 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:10 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.342s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:10 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:10:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Deleted volume successfully. Aug 01 15:10:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-050d57b8-5115-4b9e-97ef-422e16486878 tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-4f6a2c8e-58f6-4321-a424-4d80a0e15733-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "cinder-f093ba58-1623-4623-ac50-13d1333c5250-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-f093ba58-1623-4623-ac50-13d1333c5250-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "cinder-quobyte-f093ba58-1623-4623-ac50-13d1333c5250" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-quobyte-f093ba58-1623-4623-ac50-13d1333c5250" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a3449d-fe36-4f61-975f-1b4b1574aff3]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:11 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250 Aug 01 15:10:11 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:12 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250" returned: 0 in 0.487s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:12 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250 Aug 01 15:10:12 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:12 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f093ba58-1623-4623-ac50-13d1333c5250" returned: 0 in 0.324s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-quobyte-f093ba58-1623-4623-ac50-13d1333c5250" released by "delete_volume" :: held 0.862s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:12 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Created reservations ['78a405f0-a29b-4054-a4c1-08afac9a6125', 'd5ea36d9-734e-40aa-8b20-e156a234569e', 'f2372ed0-6363-445a-b79c-26d6faa0b382', 'c13dd5e8-dd79-4ae0-ad66-5ad06434ee21'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:10:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:12 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:10:12 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:13 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:13 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:10:13 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Deleted volume successfully. Aug 01 15:10:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8a1e782a-a5ad-4676-85b2-70e55266bd8e tempest-AttachVolumeNegativeTest-1581032568 None] Lock "cinder-f093ba58-1623-4623-ac50-13d1333c5250-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:10:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:18 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:10:18 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:19 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.440s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:10:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:10:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:10:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Flow 'volume_create_manager' (a019723b-6701-46e7-866c-33f02fd0d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea69b981-7f47-4f0e-8611-b50101a1cca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea69b981-7f47-4f0e-8611-b50101a1cca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-274764441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d07cc9-2f54-489a-812b-0e8fd6f4f539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928a3cbf9db44c3a98e93dc8e926cd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:10:21Z,use_quota=True,user_id='cc503c1d602a4ef78b411968aaaeb882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f74319-8ad1-4d16-b000-242915d9dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f74319-8ad1-4d16-b000-242915d9dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc6fe9a-a977-435b-a556-3c9314301067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc6fe9a-a977-435b-a556-3c9314301067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d07cc9-2f54-489a-812b-0e8fd6f4f539', 'volume_name': 'volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28dfd23-f904-40f9-aba6-9e9261d77443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28dfd23-f904-40f9-aba6-9e9261d77443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f404f64f-82bb-4d82-aebc-9516bd3bfac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:21 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Volume f8d07cc9-2f54-489a-812b-0e8fd6f4f539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539', 'volume_size': 1} Aug 01 15:10:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.540s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] Uploaded volume to glance image-id: 5ab7bab8-f1da-440d-a8d9-8c5ce0e31203. {{(pid=89024) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.582s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-274764441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d07cc9-2f54-489a-812b-0e8fd6f4f539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928a3cbf9db44c3a98e93dc8e926cd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:10:21Z,use_quota=True,user_id='cc503c1d602a4ef78b411968aaaeb882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Creating volume f8d07cc9-2f54-489a-812b-0e8fd6f4f539 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:10:27 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:27 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 1073741824 Aug 01 15:10:27 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:27 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a0e6ff12-6aee-442f-8571-d7489267013c tempest-TestImageHashVerification-753930806 None] Copy volume to image completed successfully. Aug 01 15:10:27 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 1073741824" returned: 0 in 0.438s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:27 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 Aug 01 15:10:27 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:27 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539" returned: 0 in 0.262s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f404f64f-82bb-4d82-aebc-9516bd3bfac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bee51bc-6db2-443b-8965-6ee0c65bb44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:27 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Volume volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 (f8d07cc9-2f54-489a-812b-0e8fd6f4f539): created successfully Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bee51bc-6db2-443b-8965-6ee0c65bb44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Flow 'volume_create_manager' (a019723b-6701-46e7-866c-33f02fd0d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:10:27 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6ba4ad81-d41a-4897-8441-c3222bad0990 tempest-VolumesSnapshotTestJSON-1582090995 None] Created volume successfully. Aug 01 15:10:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Acquiring lock "cinder-29246531-8f54-4ded-a0cd-de44698ae631-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Lock "cinder-29246531-8f54-4ded-a0cd-de44698ae631-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Acquiring lock "cinder-quobyte-29246531-8f54-4ded-a0cd-de44698ae631" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Lock "cinder-quobyte-29246531-8f54-4ded-a0cd-de44698ae631" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:28 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b83480-a6a0-4fbe-b5cc-65887c3a0034]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:28 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 Aug 01 15:10:29 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] Creating offline snapshot 83565fd3-6526-48b1-9d57-34bf1ed46df2 of volume f8d07cc9-2f54-489a-812b-0e8fd6f4f539 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c66a0bc-73c7-4a93-b61c-842cefd38f3d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:29 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631" returned: 0 in 0.473s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:29 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631 Aug 01 15:10:29 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:29 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 Aug 01 15:10:29 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:29 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-29246531-8f54-4ded-a0cd-de44698ae631" returned: 0 in 0.280s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Lock "cinder-quobyte-29246531-8f54-4ded-a0cd-de44698ae631" released by "delete_volume" :: held 0.803s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Created reservations ['14593289-8cd5-480d-9264-04d2a501ace8', '71505b57-8ab8-4e56-9d96-ae6e8c5e57f8', '86f5070a-41e2-4a7c-b0ae-a07e030c9390', 'cb7b67f2-9e4a-436c-8151-1a04cde1ff04'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:10:29 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539" returned: 0 in 0.397s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:29 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 1G Aug 01 15:10:29 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:29 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:10:29 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:30 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.334s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:30 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:10:30 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Deleted volume successfully. Aug 01 15:10:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-73e6c5d8-284e-4754-845d-80d484140c8f tempest-TestImageHashVerification-753930806 None] Lock "cinder-29246531-8f54-4ded-a0cd-de44698ae631-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:30 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 1G" returned: 0 in 0.614s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:30 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 Aug 01 15:10:30 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:30 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2" returned: 0 in 0.341s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:30 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 is being set with open permissions: ugo+rw Aug 01 15:10:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:30 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 Aug 01 15:10:30 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:31 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2" returned: 0 in 0.331s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:31 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.info Aug 01 15:10:31 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:31 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.info" returned: 0 in 0.313s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:31 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.info is being set with open permissions: ugo+rw Aug 01 15:10:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:31 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.info Aug 01 15:10:31 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:31 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.info" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:31 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5294643f-5e2a-4f4c-91d9-6746d94b1324 tempest-VolumesSnapshotTestJSON-1582090995 None] Create snapshot completed successfully Aug 01 15:10:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-83565fd3-6526-48b1-9d57-34bf1ed46df2-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-83565fd3-6526-48b1-9d57-34bf1ed46df2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-f8d07cc9-2f54-489a-812b-0e8fd6f4f539" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-f8d07cc9-2f54-489a-812b-0e8fd6f4f539" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-83565fd3-6526-48b1-9d57-34bf1ed46df2" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-83565fd3-6526-48b1-9d57-34bf1ed46df2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Deleting offline snapshot 83565fd3-6526-48b1-9d57-34bf1ed46df2 of volume f8d07cc9-2f54-489a-812b-0e8fd6f4f539 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:10:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] snapshot_file for this snap is: volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:10:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad400645-f702-4432-9f93-45e63cabe658]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:32 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 Aug 01 15:10:32 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:33 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2" returned: 0 in 0.501s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:10:33 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[671ca38b-ed40-4ed2-b995-808ce4b13c0d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:33 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 Aug 01 15:10:33 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:33 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539" returned: 0 in 0.436s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:33 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 Aug 01 15:10:33 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:34 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2" returned: 0 in 0.463s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:34 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2 Aug 01 15:10:34 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:34 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539.83565fd3-6526-48b1-9d57-34bf1ed46df2" returned: 0 in 0.288s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-83565fd3-6526-48b1-9d57-34bf1ed46df2" released by "_delete_snapshot" :: held 1.812s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-f8d07cc9-2f54-489a-812b-0e8fd6f4f539" released by "delete_snapshot" :: held 1.840s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:34 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Created reservations ['126c631f-6274-4457-8042-bc616e188585', '094d637d-e0a3-4020-a916-3d35831591e8', '47e44fb2-b5cf-42e6-ab9b-66753d4a371e', '98bef259-05cb-4b5e-9f23-757d7af18ffc'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:10:34 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Delete snapshot completed successfully. Aug 01 15:10:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e00d8cfd-6520-4231-8385-5e95e676ad89 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-83565fd3-6526-48b1-9d57-34bf1ed46df2-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Flow 'volume_create_manager' (5658bb63-cd49-4780-8a1f-62f8e86fff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32d369c-6b19-4319-a0e9-b9b48204a6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32d369c-6b19-4319-a0e9-b9b48204a6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-547360773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd587db-3b13-4adb-b413-d4ae0a4a2e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928a3cbf9db44c3a98e93dc8e926cd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:10:35Z,use_quota=True,user_id='cc503c1d602a4ef78b411968aaaeb882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9896c5-3f40-4dd7-bebf-b28035166657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9896c5-3f40-4dd7-bebf-b28035166657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9da9f67-52c5-41e5-b041-6742f052abb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9da9f67-52c5-41e5-b041-6742f052abb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd587db-3b13-4adb-b413-d4ae0a4a2e8a', 'volume_name': 'volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e8fd29-e768-4433-9322-88d52a09231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e8fd29-e768-4433-9322-88d52a09231d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6bc53c-67d9-4097-8277-5eb840cbba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:35 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Volume 4cd587db-3b13-4adb-b413-d4ae0a4a2e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a', 'volume_size': 1} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-547360773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd587db-3b13-4adb-b413-d4ae0a4a2e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928a3cbf9db44c3a98e93dc8e926cd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:10:35Z,use_quota=True,user_id='cc503c1d602a4ef78b411968aaaeb882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Creating volume 4cd587db-3b13-4adb-b413-d4ae0a4a2e8a {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:10:35 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:10:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:35 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a 1073741824 Aug 01 15:10:35 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:36 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a 1073741824" returned: 0 in 0.559s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:36 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a Aug 01 15:10:36 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:36 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" returned: 0 in 0.267s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:10:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6bc53c-67d9-4097-8277-5eb840cbba6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109b1cf9-4923-4ac0-b0db-2d0afee87678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:36 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Volume volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a (4cd587db-3b13-4adb-b413-d4ae0a4a2e8a): created successfully Aug 01 15:10:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109b1cf9-4923-4ac0-b0db-2d0afee87678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Flow 'volume_create_manager' (5658bb63-cd49-4780-8a1f-62f8e86fff31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:10:36 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-af18a3e7-53aa-4f19-b0e8-9011b65901cf tempest-VolumesSnapshotTestJSON-1582090995 None] Created volume successfully. Aug 01 15:10:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] Creating offline snapshot 85f41e86-4462-4477-993f-9a04c7dad92c of volume 4cd587db-3b13-4adb-b413-d4ae0a4a2e8a {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:10:37 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df53781-69bc-4312-9d01-8731b2086896]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:38 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a Aug 01 15:10:38 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Flow 'volume_create_manager' (ddd3844c-20df-49a2-bfcb-42af7b43b7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49ed872-00e8-47d3-acd7-b60ee130e934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49ed872-00e8-47d3-acd7-b60ee130e934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1371523011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e2f12e-c701-42c9-a1c9-55c5c81ad59c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3527cf76e7c645a8b9cd266fb44d167d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:10:38Z,use_quota=True,user_id='e0da3aeb847249d4b271445c3e73ea82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f8e7c3-0272-48fa-a993-5d5a8ab07690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f8e7c3-0272-48fa-a993-5d5a8ab07690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b615d80-f64e-4c0d-9082-9040164c973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b615d80-f64e-4c0d-9082-9040164c973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e2f12e-c701-42c9-a1c9-55c5c81ad59c', 'volume_name': 'volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d842c1-b9f8-4b58-93e7-431e6291b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d842c1-b9f8-4b58-93e7-431e6291b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436e4492-6792-4f2f-97b4-cebee1239298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:38 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c', 'volume_size': 1} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:38 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" returned: 0 in 0.419s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:38 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c 1G Aug 01 15:10:38 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:38 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c 1G" returned: 0 in 0.424s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:38 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c Aug 01 15:10:38 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:39 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c" returned: 0 in 0.334s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:39 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c is being set with open permissions: ugo+rw Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:39 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c Aug 01 15:10:39 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:39 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c" returned: 0 in 0.271s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:39 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.info Aug 01 15:10:39 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:39 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.info" returned: 0 in 0.256s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:39 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.info is being set with open permissions: ugo+rw Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:39 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.info Aug 01 15:10:39 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:39 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.info" returned: 0 in 0.273s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.790s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1371523011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e2f12e-c701-42c9-a1c9-55c5c81ad59c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3527cf76e7c645a8b9cd266fb44d167d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:10:38Z,use_quota=True,user_id='e0da3aeb847249d4b271445c3e73ea82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Creating volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:10:39 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:10:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:39 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c 1073741824 Aug 01 15:10:39 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a6796349-ea72-4c0c-9144-c4219de694ec tempest-VolumesSnapshotTestJSON-1582090995 None] Create snapshot completed successfully Aug 01 15:10:40 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c 1073741824" returned: 0 in 0.447s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:40 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c Aug 01 15:10:40 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:40 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" returned: 0 in 0.261s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:10:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436e4492-6792-4f2f-97b4-cebee1239298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1306bd-d9ef-4bbc-8dde-ccb16efa7340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:40 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Volume volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c (36e2f12e-c701-42c9-a1c9-55c5c81ad59c): created successfully Aug 01 15:10:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1306bd-d9ef-4bbc-8dde-ccb16efa7340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Flow 'volume_create_manager' (ddd3844c-20df-49a2-bfcb-42af7b43b7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:10:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-82bc4c1e-78b0-49c8-9c5a-fd71af31b441 tempest-SnapshotsActionsTest-767460379 None] Created volume successfully. Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] Creating offline snapshot 34a86b90-ae57-4f83-9edf-c7e8a412a845 of volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e99ad6-6878-47f7-a2b8-6af786b5e35b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:41 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c Aug 01 15:10:41 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Flow 'volume_create_manager' (67e21464-ab8b-431e-99f3-44163b2a1bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76638202-f448-457e-827e-490b27d87edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76638202-f448-457e-827e-490b27d87edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-822971817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793af702-a5a2-401d-ac1c-22779ba7c1d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928a3cbf9db44c3a98e93dc8e926cd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:10:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=85f41e86-4462-4477-993f-9a04c7dad92c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:10:42Z,use_quota=True,user_id='cc503c1d602a4ef78b411968aaaeb882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe63084-b9ea-4f14-b4cd-381a4334afd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe63084-b9ea-4f14-b4cd-381a4334afd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e812791f-9eb5-4740-966a-415802d27854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e812791f-9eb5-4740-966a-415802d27854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '793af702-a5a2-401d-ac1c-22779ba7c1d7', 'volume_name': 'volume-793af702-a5a2-401d-ac1c-22779ba7c1d7', 'volume_size': 2, 'snapshot_id': '85f41e86-4462-4477-993f-9a04c7dad92c'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7f2c28-328a-41a8-9c3b-8376b840ed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7f2c28-328a-41a8-9c3b-8376b840ed51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886576fc-1aad-41c2-b845-14f700d4138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:41 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Volume 793af702-a5a2-401d-ac1c-22779ba7c1d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-793af702-a5a2-401d-ac1c-22779ba7c1d7', 'volume_size': 2, 'snapshot_id': '85f41e86-4462-4477-993f-9a04c7dad92c'} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:41 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" returned: 0 in 0.456s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:41 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 1G Aug 01 15:10:41 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:42 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 1G" returned: 0 in 0.476s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:42 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:10:42 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:42 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.297s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:42 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 is being set with open permissions: ugo+rw Aug 01 15:10:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:42 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:10:42 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:42 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.243s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:42 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=68,cinder:SELECT=70,cinder:INSERT=13,cinder:DELETE=7 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:10:42 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=66,cinder:UPDATE=67,cinder:INSERT=18,cinder:DELETE=5 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:10:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:42 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.info Aug 01 15:10:42 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:43 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.info" returned: 0 in 0.260s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:43 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.info is being set with open permissions: ugo+rw Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:43 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.info Aug 01 15:10:43 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:43 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.info" returned: 0 in 0.285s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.757s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-85f41e86-4462-4477-993f-9a04c7dad92c-793af702-a5a2-401d-ac1c-22779ba7c1d7" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-85f41e86-4462-4477-993f-9a04c7dad92c-793af702-a5a2-401d-ac1c-22779ba7c1d7" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Creating volume 793af702-a5a2-401d-ac1c-22779ba7c1d7 from snapshot 85f41e86-4462-4477-993f-9a04c7dad92c {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-793af702-a5a2-401d-ac1c-22779ba7c1d7" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-18d4d58d-eb2c-4b6a-a137-b01f44813f9f tempest-SnapshotsActionsTest-767460379 None] Create snapshot completed successfully Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-793af702-a5a2-401d-ac1c-22779ba7c1d7" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] snapshot: 85f41e86-4462-4477-993f-9a04c7dad92c, volume: 793af702-a5a2-401d-ac1c-22779ba7c1d7, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f70a1-c652-4f7d-a073-be7ea3799c01]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:43 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c Aug 01 15:10:43 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:43 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c" returned: 0 in 0.365s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd364992-6779-4732-9bc9-6e6524b250c2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:44 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a Aug 01 15:10:44 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:44 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" returned: 0 in 0.419s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:10:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:10:44 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:10:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:44 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 Aug 01 15:10:44 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:49 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7" returned: 0 in 5.251s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:49 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:10:49 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Converted 1024.00 MB image at 194.98 MB/s Aug 01 15:10:49 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 is being set with open permissions: ugo+rw Aug 01 15:10:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:49 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 Aug 01 15:10:49 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:49 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7" returned: 0 in 0.274s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-793af702-a5a2-401d-ac1c-22779ba7c1d7" released by "_copy_volume_from_snapshot" :: held 6.408s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-85f41e86-4462-4477-993f-9a04c7dad92c-793af702-a5a2-401d-ac1c-22779ba7c1d7" released by "_create_volume_from_snapshot" :: held 6.491s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.513s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.326s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] Creating offline snapshot d1ce1175-85df-486c-897f-0def7a6b95a3 of volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886576fc-1aad-41c2-b845-14f700d4138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793af702-a5a2-401d-ac1c-22779ba7c1d7', 'volume_size': 2, 'snapshot_id': '85f41e86-4462-4477-993f-9a04c7dad92c'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1111815e-4cf7-4823-be1c-31224c55646c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d0a006-1053-400c-a881-6144210f823e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:50 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Volume volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 (793af702-a5a2-401d-ac1c-22779ba7c1d7): created successfully Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1111815e-4cf7-4823-be1c-31224c55646c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Flow 'volume_create_manager' (67e21464-ab8b-431e-99f3-44163b2a1bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:10:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c5f57a0c-f544-4bec-a129-ef7583afce34 tempest-VolumesSnapshotTestJSON-1582090995 None] Created volume successfully. Aug 01 15:10:50 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:10:50 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:50 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.474s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:10:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:50 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 1G Aug 01 15:10:50 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-793af702-a5a2-401d-ac1c-22779ba7c1d7-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-793af702-a5a2-401d-ac1c-22779ba7c1d7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-793af702-a5a2-401d-ac1c-22779ba7c1d7" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:51 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-793af702-a5a2-401d-ac1c-22779ba7c1d7" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 1G" returned: 0 in 0.617s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7abf68a-1096-44a3-9ceb-f31b868820f4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:51 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 Aug 01 15:10:51 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:51 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 Aug 01 15:10:51 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:51 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3" returned: 0 in 0.307s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:51 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 is being set with open permissions: ugo+rw Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:51 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 Aug 01 15:10:51 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:51 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7" returned: 0 in 0.409s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:51 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7 Aug 01 15:10:51 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:51 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3" returned: 0 in 0.280s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f23d6000-5375-48b9-a044-c5f4962007eb tempest-SnapshotsActionsTest-767460379 None] Create snapshot completed successfully Aug 01 15:10:51 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-793af702-a5a2-401d-ac1c-22779ba7c1d7" returned: 0 in 0.281s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-793af702-a5a2-401d-ac1c-22779ba7c1d7" released by "delete_volume" :: held 0.730s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:51 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Created reservations ['808b99ce-9efd-4609-b48d-3cc2de26be67', 'c4b0d2bf-1404-4049-93bf-86e5fac72bde', '2a4f65b7-94db-4c7b-ae14-7c28aaccb17c', '9e58b0e7-ee8c-4c93-97f8-6aeadfc547c6'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:52 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:10:52 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-d1ce1175-85df-486c-897f-0def7a6b95a3-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-d1ce1175-85df-486c-897f-0def7a6b95a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:52 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-quobyte-d1ce1175-85df-486c-897f-0def7a6b95a3" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-85f41e86-4462-4477-993f-9a04c7dad92c-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.333s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:10:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Deleted volume successfully. Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-d1ce1175-85df-486c-897f-0def7a6b95a3" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Deleting offline snapshot d1ce1175-85df-486c-897f-0def7a6b95a3 of volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] snapshot_file for this snap is: volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-85f41e86-4462-4477-993f-9a04c7dad92c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c98100-78d0-4870-b750-80bd8d0d5f7e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-85f41e86-4462-4477-993f-9a04c7dad92c" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28e789e9-adb0-4ca4-a387-1108c8aa01d7 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-793af702-a5a2-401d-ac1c-22779ba7c1d7-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-85f41e86-4462-4477-993f-9a04c7dad92c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Deleting offline snapshot 85f41e86-4462-4477-993f-9a04c7dad92c of volume 4cd587db-3b13-4adb-b413-d4ae0a4a2e8a {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] snapshot_file for this snap is: volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4288fc7-8990-4577-a3f5-a70dee904274]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:52 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 Aug 01 15:10:52 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:52 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c Aug 01 15:10:52 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:52 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3" returned: 0 in 0.427s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f081308-1bac-4991-afda-0ab591fe1d64]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:53 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c" returned: 0 in 0.495s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:10:53 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0934b31c-9cfa-4e3e-ace8-b70c52c43065]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:53 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:10:53 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:53 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a Aug 01 15:10:53 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:53 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.477s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:10:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:53 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 Aug 01 15:10:53 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:53 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" returned: 0 in 0.648s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:53 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c Aug 01 15:10:53 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:53 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3" returned: 0 in 0.437s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:53 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3 Aug 01 15:10:53 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:54 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.d1ce1175-85df-486c-897f-0def7a6b95a3" returned: 0 in 0.278s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:54 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c" returned: 0 in 0.426s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-d1ce1175-85df-486c-897f-0def7a6b95a3" released by "_delete_snapshot" :: held 1.776s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" released by "delete_snapshot" :: held 1.825s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:54 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c Aug 01 15:10:54 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Created reservations ['322c9112-a095-4367-a75e-f7104603ff31', '241f674e-e3d9-4c1c-8f3c-23754bdcde1c', '42857b5f-cd99-4f36-a8d8-0d3cff0828c0', '1d9564c8-e3cc-475e-a7bb-8c2fb67c3377'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:10:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Delete snapshot completed successfully. Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0c36c8e5-efbb-45c8-99c7-e49aae6f1da6 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-d1ce1175-85df-486c-897f-0def7a6b95a3-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:54 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a.85f41e86-4462-4477-993f-9a04c7dad92c" returned: 0 in 0.360s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-85f41e86-4462-4477-993f-9a04c7dad92c" released by "_delete_snapshot" :: held 2.067s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" released by "delete_snapshot" :: held 2.101s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Created reservations ['955d14f7-6a51-4038-ad9e-9321fd6714aa', 'b5982d1f-6973-4d8f-934e-a6b26c6cd8dc', '525dba65-9fee-4dd6-af3a-46024eac166a', 'c1b68002-b9f6-4e27-8883-902f3f8d105c'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:10:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Delete snapshot completed successfully. Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fddd7ac7-28a4-4b65-96c1-2b9082ff61c6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-85f41e86-4462-4477-993f-9a04c7dad92c-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] Creating offline snapshot 2ccdab08-1343-4e0e-9660-7415842f3588 of volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4b7f38-b517-44dd-9aaf-25e33070d22b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:55 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:10:55 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:55 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.372s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:10:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:55 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 1G Aug 01 15:10:55 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b286ae5-01cf-49a6-997d-e98fc7434f70]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:55 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 1G" returned: 0 in 0.542s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:55 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 Aug 01 15:10:55 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:55 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a Aug 01 15:10:55 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:56 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588" returned: 0 in 0.300s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:56 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 is being set with open permissions: ugo+rw Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:56 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 Aug 01 15:10:56 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:56 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" returned: 0 in 0.410s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:56 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a Aug 01 15:10:56 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:56 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588" returned: 0 in 0.256s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.605s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e7598853-49b7-4a3b-8480-3735a053fbd8 tempest-SnapshotsActionsTest-767460379 None] Create snapshot completed successfully Aug 01 15:10:56 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" returned: 0 in 0.268s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a" released by "delete_volume" :: held 0.740s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Created reservations ['696fd101-9001-4bb4-aaaf-02f1c5c5df25', 'e10257b5-b89e-4471-961f-3dcb776068aa', 'f9eab579-0b5a-482d-8f72-2b308006a74d', 'a8d138d8-05f5-4ca9-98a5-b9e994f023fa'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:56 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:10:56 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:56 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.288s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:10:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Deleted volume successfully. Aug 01 15:10:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45ddff15-ef00-4545-aae4-9c941ed3b4a0 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-4cd587db-3b13-4adb-b413-d4ae0a4a2e8a-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-2ccdab08-1343-4e0e-9660-7415842f3588-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-2ccdab08-1343-4e0e-9660-7415842f3588-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-quobyte-2ccdab08-1343-4e0e-9660-7415842f3588" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-2ccdab08-1343-4e0e-9660-7415842f3588" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Deleting offline snapshot 2ccdab08-1343-4e0e-9660-7415842f3588 of volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] snapshot_file for this snap is: volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c169c1b-be91-4e1b-9fd0-25a2dc1116fb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:57 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 Aug 01 15:10:57 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Flow 'volume_create_manager' (6edea709-63bb-4fda-937f-9490a668e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5cf38a2-76dc-4079-a103-ab2d24e8864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5cf38a2-76dc-4079-a103-ab2d24e8864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1808764468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3434f0a5-38b3-4f68-a802-1371a2ab4929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928a3cbf9db44c3a98e93dc8e926cd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:10:57Z,use_quota=True,user_id='cc503c1d602a4ef78b411968aaaeb882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14b66fc-dfe8-4604-a97f-4ec82adf68d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14b66fc-dfe8-4604-a97f-4ec82adf68d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203fc51c-fcc0-4cde-9576-1c9b825c11e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (203fc51c-fcc0-4cde-9576-1c9b825c11e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3434f0a5-38b3-4f68-a802-1371a2ab4929', 'volume_name': 'volume-3434f0a5-38b3-4f68-a802-1371a2ab4929', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d8aace-9d6e-431d-94aa-e9343b91b95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d8aace-9d6e-431d-94aa-e9343b91b95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9674887-e63b-459d-a301-081712bf403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:57 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Volume 3434f0a5-38b3-4f68-a802-1371a2ab4929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3434f0a5-38b3-4f68-a802-1371a2ab4929', 'volume_size': 1} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1808764468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3434f0a5-38b3-4f68-a802-1371a2ab4929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928a3cbf9db44c3a98e93dc8e926cd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:10:57Z,use_quota=True,user_id='cc503c1d602a4ef78b411968aaaeb882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Creating volume 3434f0a5-38b3-4f68-a802-1371a2ab4929 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:10:57 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:57 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588" returned: 0 in 0.458s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:10:57 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 1073741824 Aug 01 15:10:57 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fc43d7-5e80-47e9-b600-1d0142509ef8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:57 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:10:57 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:58 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.395s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:58 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 1073741824" returned: 0 in 0.478s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:58 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 Aug 01 15:10:58 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:58 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 Aug 01 15:10:58 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:58 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929" returned: 0 in 0.287s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9674887-e63b-459d-a301-081712bf403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3434f0a5-38b3-4f68-a802-1371a2ab4929', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b77fbd-85ea-4391-948d-c8d854e591fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:10:58 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Volume volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 (3434f0a5-38b3-4f68-a802-1371a2ab4929): created successfully Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b77fbd-85ea-4391-948d-c8d854e591fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:10:58 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Flow 'volume_create_manager' (6edea709-63bb-4fda-937f-9490a668e74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588" returned: 0 in 0.408s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:58 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d4b01736-7b61-422c-889a-25bf624da937 tempest-VolumesSnapshotTestJSON-1582090995 None] Created volume successfully. Aug 01 15:10:58 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588 Aug 01 15:10:58 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:10:58 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.2ccdab08-1343-4e0e-9660-7415842f3588" returned: 0 in 0.250s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-2ccdab08-1343-4e0e-9660-7415842f3588" released by "_delete_snapshot" :: held 1.618s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" released by "delete_snapshot" :: held 1.645s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:58 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Created reservations ['959e9064-418f-49df-bd4f-99433c601adb', '88d82849-0777-40b5-87d1-4f0e454d5f20', '6037163a-620d-4e12-92d1-0ab135f50fd8', '2832334e-6c93-47b5-b4f2-339769b58262'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:10:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Delete snapshot completed successfully. Aug 01 15:10:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ef802d0-f44c-43b3-a830-e2a3a73c1dfa tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-2ccdab08-1343-4e0e-9660-7415842f3588-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:10:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:10:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] Creating offline snapshot fca0159d-994a-4e9e-a98d-737a53cec4e9 of volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:10:59 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7072a9df-14af-4ee2-990b-95634ab23e67]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:10:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:10:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:10:59 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:10:59 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:00 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.388s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:11:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:00 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 1G Aug 01 15:11:00 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:00 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 1G" returned: 0 in 0.469s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:00 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 Aug 01 15:11:00 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:00 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9" returned: 0 in 0.318s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:00 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 is being set with open permissions: ugo+rw Aug 01 15:11:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:00 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 Aug 01 15:11:00 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:01 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9" returned: 0 in 0.261s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.601s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.410s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] Creating offline snapshot 6a45d446-6854-4c48-b10f-6e5eaaaa1c09 of volume 3434f0a5-38b3-4f68-a802-1371a2ab4929 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:11:01 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e7202e12-bb20-4d77-9134-60c9ba5e74dd tempest-SnapshotsActionsTest-767460379 None] Create snapshot completed successfully Aug 01 15:11:01 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9c7b24-eb03-472d-9932-9d464647c72d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:01 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 Aug 01 15:11:01 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:01 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929" returned: 0 in 0.425s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:01 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 1G Aug 01 15:11:01 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-fca0159d-994a-4e9e-a98d-737a53cec4e9-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-fca0159d-994a-4e9e-a98d-737a53cec4e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-quobyte-fca0159d-994a-4e9e-a98d-737a53cec4e9" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-fca0159d-994a-4e9e-a98d-737a53cec4e9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Deleting offline snapshot fca0159d-994a-4e9e-a98d-737a53cec4e9 of volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] snapshot_file for this snap is: volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcc9d25-e682-4417-882a-bee5455e4b39]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:02 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 Aug 01 15:11:02 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:02 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 1G" returned: 0 in 0.510s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:02 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 Aug 01 15:11:02 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:02 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9" returned: 0 in 0.397s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7f3e90-e738-49a6-9dfb-fbc75b48dea2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:02 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09" returned: 0 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:02 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 is being set with open permissions: ugo+rw Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:02 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:11:02 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:02 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 Aug 01 15:11:02 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:02 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09" returned: 0 in 0.285s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:02 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.440s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:02 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 Aug 01 15:11:02 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:03 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.info Aug 01 15:11:03 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:03 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.info" returned: 0 in 0.327s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:03 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.info is being set with open permissions: ugo+rw Aug 01 15:11:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:03 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.info Aug 01 15:11:03 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:03 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9" returned: 0 in 0.496s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:03 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9 Aug 01 15:11:03 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:03 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.info" returned: 0 in 0.302s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.362s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d4ce3539-c354-4b47-818c-5bb75bdaec63 tempest-VolumesSnapshotTestJSON-1582090995 None] Create snapshot completed successfully Aug 01 15:11:03 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.fca0159d-994a-4e9e-a98d-737a53cec4e9" returned: 0 in 0.315s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-fca0159d-994a-4e9e-a98d-737a53cec4e9" released by "_delete_snapshot" :: held 1.753s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" released by "delete_snapshot" :: held 1.779s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:03 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Created reservations ['7ac8f6a9-3c1b-4d1e-a2a0-bdf4b84b23d7', '0622539a-9f0a-48e3-8095-c50db046a391', '8f9da831-298d-4ecb-b2b4-a35db041fa5b', 'c54a40ca-f259-4552-8ab4-d1aa8d2a1849'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Delete snapshot completed successfully. Aug 01 15:11:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0a9222c-caaa-4d2a-8fb9-2bbcc7b123b9 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-fca0159d-994a-4e9e-a98d-737a53cec4e9-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] Creating offline snapshot 1c70bf75-ab8c-4130-8261-5dbc2fb7814c of volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f5b8b-4468-4de8-b1ca-cce6ff468c29]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:11:04 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:11:04 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Flow 'volume_create_manager' (909c9f56-8127-41a1-ae18-f89691a86804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0396d23-7ce7-4a08-bc6b-30b3216695ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0396d23-7ce7-4a08-bc6b-30b3216695ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1429025668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928a3cbf9db44c3a98e93dc8e926cd59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6a45d446-6854-4c48-b10f-6e5eaaaa1c09,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:11:05Z,use_quota=True,user_id='cc503c1d602a4ef78b411968aaaeb882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90668814-af12-4ee0-bfee-449549856054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90668814-af12-4ee0-bfee-449549856054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d7ee13-01d0-47a5-9ded-effce6b274cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d7ee13-01d0-47a5-9ded-effce6b274cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74', 'volume_name': 'volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74', 'volume_size': 1, 'snapshot_id': '6a45d446-6854-4c48-b10f-6e5eaaaa1c09'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b087bf1-e920-473d-be3d-4f8597ffaf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b087bf1-e920-473d-be3d-4f8597ffaf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e5211f-b12f-4b4e-99dc-c1e590456a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:05 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Volume 4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74', 'volume_size': 1, 'snapshot_id': '6a45d446-6854-4c48-b10f-6e5eaaaa1c09'} Aug 01 15:11:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:05 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.421s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:11:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:05 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c 1G Aug 01 15:11:05 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:05 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c 1G" returned: 0 in 0.472s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:05 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c Aug 01 15:11:05 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:06 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c" returned: 0 in 0.312s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:06 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c is being set with open permissions: ugo+rw Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:06 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c Aug 01 15:11:06 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:06 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c" returned: 0 in 0.265s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.572s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.277s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-6a45d446-6854-4c48-b10f-6e5eaaaa1c09-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-6a45d446-6854-4c48-b10f-6e5eaaaa1c09-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Creating volume 4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 from snapshot 6a45d446-6854-4c48-b10f-6e5eaaaa1c09 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:06 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4d11100e-13cf-4d42-99e4-936f73247712 tempest-SnapshotsActionsTest-767460379 None] Create snapshot completed successfully Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] snapshot: 6a45d446-6854-4c48-b10f-6e5eaaaa1c09, volume: 4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6502904-fff8-41d0-9169-023dadbe8373]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:06 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 Aug 01 15:11:06 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:06 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09" returned: 0 in 0.382s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3434f0a5-38b3-4f68-a802-1371a2ab4929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bbbd38-f319-4402-8d34-b6dc8acbc4a5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-1c70bf75-ab8c-4130-8261-5dbc2fb7814c-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-1c70bf75-ab8c-4130-8261-5dbc2fb7814c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Acquiring lock "cinder-quobyte-1c70bf75-ab8c-4130-8261-5dbc2fb7814c" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:06 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 Aug 01 15:11:06 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-1c70bf75-ab8c-4130-8261-5dbc2fb7814c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Deleting offline snapshot 1c70bf75-ab8c-4130-8261-5dbc2fb7814c of volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] snapshot_file for this snap is: volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c783cc12-9c8e-4ac5-80b2-bda3331e8e0b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:07 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c Aug 01 15:11:07 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:07 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929" returned: 0 in 0.460s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:07 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 Aug 01 15:11:07 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:07 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c" returned: 0 in 0.412s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66512f2-bbdf-4ce4-8318-7f064bb9ac3a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:07 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:11:07 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Flow 'volume_create_manager' (0a8ca611-d97a-4104-9576-ccaaa23bef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9abc8f-dc6c-46f5-b63e-8aac32b6619b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9abc8f-dc6c-46f5-b63e-8aac32b6619b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1825067031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7756b121-f44e-485f-a2cd-3257ebf28540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c77a0e314eb4db5be209ae27e60328a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:11:08Z,use_quota=True,user_id='37cc0ebc232d4341b865a9b011252f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1725a8-a28b-4200-91b3-c50dd9c3facd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1725a8-a28b-4200-91b3-c50dd9c3facd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcdaff6-8d8e-42d2-9099-52e6183ddb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcdaff6-8d8e-42d2-9099-52e6183ddb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7756b121-f44e-485f-a2cd-3257ebf28540', 'volume_name': 'volume-7756b121-f44e-485f-a2cd-3257ebf28540', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20b3340-8be1-4a2d-989b-a632eeebbb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20b3340-8be1-4a2d-989b-a632eeebbb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15a08a9-5660-427a-b28e-9f038826e292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:07 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Volume 7756b121-f44e-485f-a2cd-3257ebf28540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7756b121-f44e-485f-a2cd-3257ebf28540', 'volume_size': 1} Aug 01 15:11:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:08 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.621s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:11:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:08 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c Aug 01 15:11:08 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:09 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c" returned: 0 in 0.936s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:09 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c Aug 01 15:11:09 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:09 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.1c70bf75-ab8c-4130-8261-5dbc2fb7814c" returned: 0 in 0.666s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-1c70bf75-ab8c-4130-8261-5dbc2fb7814c" released by "_delete_snapshot" :: held 2.821s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" released by "delete_snapshot" :: held 2.877s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:09 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Created reservations ['05a63f0f-92fb-419c-b2d5-a117650d0c9d', '789fae7b-b281-4151-8536-4f2ae52760cb', 'bb16179f-acbe-4491-8662-78b05588a684', '2fb3b956-8466-4a23-bf9f-bba914964a70'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Delete snapshot completed successfully. Aug 01 15:11:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94183705-f2e6-4cf2-b324-215bd7330a79 tempest-SnapshotsActionsTest-2050590469 None] Lock "cinder-1c70bf75-ab8c-4130-8261-5dbc2fb7814c-delete_snapshot" released by "delete_snapshot" :: held 3.171s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "cinder-34a86b90-ae57-4f83-9edf-c7e8a412a845-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Lock "cinder-34a86b90-ae57-4f83-9edf-c7e8a412a845-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "cinder-quobyte-34a86b90-ae57-4f83-9edf-c7e8a412a845" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Lock "cinder-quobyte-34a86b90-ae57-4f83-9edf-c7e8a412a845" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Deleting offline snapshot 34a86b90-ae57-4f83-9edf-c7e8a412a845 of volume 36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:11:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] snapshot_file for this snap is: volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:11:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70edfd2-edb8-41d2-b906-456ed65ce5eb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:12 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:11:12 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:12 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.947s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:11:12 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eac716-f970-4a22-a370-ce5409291caa]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:12 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" returned: 0 in 5.700s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:12 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:11:12 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Converted 1024.00 MB image at 179.60 MB/s Aug 01 15:11:12 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 is being set with open permissions: ugo+rw Aug 01 15:11:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:13 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 Aug 01 15:11:13 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:13 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c Aug 01 15:11:13 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:13 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" returned: 0 in 0.326s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" released by "_copy_volume_from_snapshot" :: held 6.970s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:13 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" returned: 0 in 0.570s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-6a45d446-6854-4c48-b10f-6e5eaaaa1c09-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" released by "_create_volume_from_snapshot" :: held 7.082s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.118s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.619s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1825067031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7756b121-f44e-485f-a2cd-3257ebf28540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c77a0e314eb4db5be209ae27e60328a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:11:08Z,use_quota=True,user_id='37cc0ebc232d4341b865a9b011252f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Creating volume 7756b121-f44e-485f-a2cd-3257ebf28540 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:13 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:11:13 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:11:13 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:13 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 1073741824 Aug 01 15:11:13 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e5211f-b12f-4b4e-99dc-c1e590456a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74', 'volume_size': 1, 'snapshot_id': '6a45d446-6854-4c48-b10f-6e5eaaaa1c09'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784db4b0-9936-4c1c-8667-92a081b1a7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:13 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Volume volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 (4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74): created successfully Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784db4b0-9936-4c1c-8667-92a081b1a7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Flow 'volume_create_manager' (909c9f56-8127-41a1-ae18-f89691a86804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:13 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-db577afe-1582-4152-bac1-7cdac5ef283c tempest-VolumesSnapshotTestJSON-1582090995 None] Created volume successfully. Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:14 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.629s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" acquired by "delete_volume" :: waited 0.045s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:14 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845 Aug 01 15:11:14 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[970b3206-f5c9-4041-bdeb-2e126bcf4649]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:14 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 1073741824" returned: 0 in 0.801s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:14 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 Aug 01 15:11:14 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:14 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 Aug 01 15:11:14 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:14 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c.34a86b90-ae57-4f83-9edf-c7e8a412a845" returned: 0 in 0.415s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Lock "cinder-quobyte-34a86b90-ae57-4f83-9edf-c7e8a412a845" released by "_delete_snapshot" :: held 2.820s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" released by "delete_snapshot" :: held 2.866s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Created reservations ['7ce6af6d-1e5a-44dd-b0ae-b653d9a44f1c', '3c7a8add-b996-4043-9907-234f2d4464e0', 'bae36c59-0d13-4d89-8b6f-d372ab331723', '2a517c04-eea6-48e6-9d54-ce237dc89d2e'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:14 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" returned: 0 in 0.507s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:14 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74 Aug 01 15:11:14 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:14 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Delete snapshot completed successfully. Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b5488e1f-b2ea-4d41-9b08-c16683caa4ad tempest-SnapshotsActionsTest-767460379 None] Lock "cinder-34a86b90-ae57-4f83-9edf-c7e8a412a845-delete_snapshot" released by "delete_snapshot" :: held 3.108s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:14 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540" returned: 0 in 0.410s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15a08a9-5660-427a-b28e-9f038826e292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7756b121-f44e-485f-a2cd-3257ebf28540', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650ef7bd-0586-430c-a20f-8ee0bad0d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:14 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Volume volume-7756b121-f44e-485f-a2cd-3257ebf28540 (7756b121-f44e-485f-a2cd-3257ebf28540): created successfully Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (650ef7bd-0586-430c-a20f-8ee0bad0d190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Flow 'volume_create_manager' (0a8ca611-d97a-4104-9576-ccaaa23bef5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:14 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7cb7056c-470e-4895-aa8b-fb05329c56db tempest-TestStampPattern-519944343 None] Created volume successfully. Aug 01 15:11:14 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" returned: 0 in 0.342s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74" released by "delete_volume" :: held 0.921s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "cinder-36e2f12e-c701-42c9-a1c9-55c5c81ad59c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Created reservations ['155e16cc-3785-48c5-8a6b-b3d037167974', '9ffbf064-6b4e-49e1-acff-7ad9e1f3f02f', 'ebd1f955-4516-4f45-9e02-06d98dc9cf24', 'f899acd6-975a-48ba-9771-dba770e3540f'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Lock "cinder-36e2f12e-c701-42c9-a1c9-55c5c81ad59c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[68172f59-81f9-4c11-aef0-097d3edcdc6b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:15 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:11:15 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:15 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c Aug 01 15:11:15 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:15 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.292s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:11:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Deleted volume successfully. Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-41ca7625-a4a5-4cfb-8ba9-4c7fe37764b6 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-4b98aceb-b6cd-4f92-ad2a-dd0cf6bebe74-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:15 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" returned: 0 in 0.445s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:15 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c Aug 01 15:11:15 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:15 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" returned: 0 in 0.280s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Lock "cinder-quobyte-36e2f12e-c701-42c9-a1c9-55c5c81ad59c" released by "delete_volume" :: held 0.810s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Created reservations ['685416bd-0778-4599-b182-943c37d068b8', 'a565226f-2f79-4436-b75b-70171c2d034e', '58a62a07-52ce-44f2-88b3-9e41b057c888', '194c0328-74b6-41dc-8719-304fe82312fc'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:16 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:11:16 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-6a45d446-6854-4c48-b10f-6e5eaaaa1c09-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-6a45d446-6854-4c48-b10f-6e5eaaaa1c09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-3434f0a5-38b3-4f68-a802-1371a2ab4929" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-3434f0a5-38b3-4f68-a802-1371a2ab4929" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-6a45d446-6854-4c48-b10f-6e5eaaaa1c09" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-6a45d446-6854-4c48-b10f-6e5eaaaa1c09" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Deleting offline snapshot 6a45d446-6854-4c48-b10f-6e5eaaaa1c09 of volume 3434f0a5-38b3-4f68-a802-1371a2ab4929 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] snapshot_file for this snap is: volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b266b0f-4786-4706-ae78-6784810ca2af]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:16 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.338s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:11:16 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Deleted volume successfully. Aug 01 15:11:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a406a1f-c671-458e-b8bb-4f0b9f1182a1 tempest-SnapshotsActionsTest-767460379 None] Lock "cinder-36e2f12e-c701-42c9-a1c9-55c5c81ad59c-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:16 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 Aug 01 15:11:16 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:17 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09" returned: 0 in 0.706s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3434f0a5-38b3-4f68-a802-1371a2ab4929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:11:17 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce269a0-87d2-4ac9-8669-ae2e25c9c6de]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:17 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 Aug 01 15:11:17 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:17 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929" returned: 0 in 0.764s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:18 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 Aug 01 15:11:18 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:18 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09" returned: 0 in 0.426s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:18 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09 Aug 01 15:11:18 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:18 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:11:18 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:18 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929.6a45d446-6854-4c48-b10f-6e5eaaaa1c09" returned: 0 in 0.332s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-6a45d446-6854-4c48-b10f-6e5eaaaa1c09" released by "_delete_snapshot" :: held 2.385s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-3434f0a5-38b3-4f68-a802-1371a2ab4929" released by "delete_snapshot" :: held 2.422s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:18 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.332s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:11:18 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Created reservations ['6b0e3b9e-9801-42c5-bf0b-b1f561c5a6a0', '1e107335-0f86-4ebe-b7a5-fc66afc03fdc', '8ad8df9f-d9db-4703-b3de-8de777f6292f', '4b905d84-dfb0-4fa0-9843-bd836e9bf1a9'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Delete snapshot completed successfully. Aug 01 15:11:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63215df1-e1cf-40b5-803e-0c6f5be51380 tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-6a45d446-6854-4c48-b10f-6e5eaaaa1c09-delete_snapshot" released by "delete_snapshot" :: held 2.687s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-3434f0a5-38b3-4f68-a802-1371a2ab4929-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-3434f0a5-38b3-4f68-a802-1371a2ab4929-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-3434f0a5-38b3-4f68-a802-1371a2ab4929" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-3434f0a5-38b3-4f68-a802-1371a2ab4929" acquired by "delete_volume" :: waited 0.046s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f864a434-efac-4239-b59c-97d3c4f52cbe]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:20 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 Aug 01 15:11:20 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:20 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929" returned: 0 in 0.540s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:20 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929 Aug 01 15:11:20 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:20 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3434f0a5-38b3-4f68-a802-1371a2ab4929" returned: 0 in 0.387s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-3434f0a5-38b3-4f68-a802-1371a2ab4929" released by "delete_volume" :: held 1.024s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:21 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Created reservations ['f5c9aefc-b010-4bca-89c6-2053a13946b9', '653f105f-f327-4ea5-b9fa-2132a3db77b0', 'f60fb9f9-57fa-45c8-8da5-0c39c5393bce', '3c4ccc5a-bfcb-4e5a-970a-990851196c4d'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:21 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:11:21 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:21 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.373s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:21 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:11:21 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Deleted volume successfully. Aug 01 15:11:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4ec8dd70-07a3-4aa0-97a1-fc5ea7ab5d9e tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-3434f0a5-38b3-4f68-a802-1371a2ab4929-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-f8d07cc9-2f54-489a-812b-0e8fd6f4f539-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-f8d07cc9-2f54-489a-812b-0e8fd6f4f539-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "cinder-quobyte-f8d07cc9-2f54-489a-812b-0e8fd6f4f539" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-f8d07cc9-2f54-489a-812b-0e8fd6f4f539" acquired by "delete_volume" :: waited 0.060s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:22 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4969aaf-5d2a-41e5-9906-9b0225e83d54]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:22 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 Aug 01 15:11:22 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:23 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539" returned: 0 in 0.452s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:23 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539 Aug 01 15:11:23 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:23 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8d07cc9-2f54-489a-812b-0e8fd6f4f539" returned: 0 in 0.299s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-quobyte-f8d07cc9-2f54-489a-812b-0e8fd6f4f539" released by "delete_volume" :: held 0.819s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Created reservations ['205df5b5-5fe3-4d8b-879a-a45da4265cbd', 'cbf40a49-fae1-4678-b38e-29981751f09d', 'e20fc396-2361-449f-ad2b-f6130ae1090f', '7ee6081e-f69d-41c7-a34c-8429d3502ed9'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:23 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:11:23 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:23 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.479s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:23 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:11:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Deleted volume successfully. Aug 01 15:11:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d40445ee-2352-4b32-a7bf-2ec11bc76ceb tempest-VolumesSnapshotTestJSON-1582090995 None] Lock "cinder-f8d07cc9-2f54-489a-812b-0e8fd6f4f539-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Flow 'volume_create_manager' (db37efe9-683c-4744-8244-0a425746b511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045ffe42-cd93-47be-bdda-e5d87d2ca7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045ffe42-cd93-47be-bdda-e5d87d2ca7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-77280202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a0aed6-4832-4ecf-8e2b-7e86e498bd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b55bd3027041d59db0e8eb009bdacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:11:25Z,use_quota=True,user_id='246da05cc7954211b251bd6fe6175b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dbb790-d819-442c-acd1-a3e4dfdf7ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dbb790-d819-442c-acd1-a3e4dfdf7ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8dd53cd-267c-4131-9875-a77e6357a40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8dd53cd-267c-4131-9875-a77e6357a40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a0aed6-4832-4ecf-8e2b-7e86e498bd66', 'volume_name': 'volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09407654-0a69-4b42-a0ec-db8fe53b61ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09407654-0a69-4b42-a0ec-db8fe53b61ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d63fc8-9b77-47f9-b646-e7d3f0765a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:25 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Volume f1a0aed6-4832-4ecf-8e2b-7e86e498bd66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66', 'volume_size': 1} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-77280202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a0aed6-4832-4ecf-8e2b-7e86e498bd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b55bd3027041d59db0e8eb009bdacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:11:25Z,use_quota=True,user_id='246da05cc7954211b251bd6fe6175b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Creating volume f1a0aed6-4832-4ecf-8e2b-7e86e498bd66 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:11:25 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:25 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66 1073741824 Aug 01 15:11:25 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:25 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66 1073741824" returned: 0 in 0.453s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:26 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66 Aug 01 15:11:26 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:26 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66" returned: 0 in 0.268s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:11:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d63fc8-9b77-47f9-b646-e7d3f0765a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6141bab9-0ec4-4d91-9342-90ed5ad56e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:26 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Volume volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66 (f1a0aed6-4832-4ecf-8e2b-7e86e498bd66): created successfully Aug 01 15:11:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6141bab9-0ec4-4d91-9342-90ed5ad56e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Flow 'volume_create_manager' (db37efe9-683c-4744-8244-0a425746b511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-da47ae76-e534-4c38-b221-f5f04d890f52 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Created volume successfully. Aug 01 15:11:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Acquiring lock "cinder-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "cinder-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Acquiring lock "cinder-quobyte-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "cinder-quobyte-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:27 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18f9779-1abe-4833-9b29-7d586bbb52f8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:28 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66 Aug 01 15:11:28 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:28 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66" returned: 0 in 0.528s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:28 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66 Aug 01 15:11:28 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:28 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66" returned: 0 in 0.333s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "cinder-quobyte-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66" released by "delete_volume" :: held 0.965s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:28 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Created reservations ['8880cf66-3ac8-4db6-b891-8bd71c372450', '6032a9c2-5d65-4feb-9327-7d33efcbfd1e', '4bcb07c1-fb53-4069-a997-e0ada5425aa8', 'bffadabb-9a44-4e00-8627-f7b9a7b7cef5'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:28 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:11:28 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:29 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.288s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:29 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:11:29 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Deleted volume successfully. Aug 01 15:11:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1d87c152-7921-4b90-af36-a8944d209fc2 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "cinder-f1a0aed6-4832-4ecf-8e2b-7e86e498bd66-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Flow 'volume_create_manager' (6c4a52f5-e593-4836-b732-c7b8860cdac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05b003a-e6b7-40ca-80cd-c0b48c65d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05b003a-e6b7-40ca-80cd-c0b48c65d39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-114143382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcf8407-5824-44f4-a208-b1d96082e668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b55bd3027041d59db0e8eb009bdacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:11:31Z,use_quota=True,user_id='246da05cc7954211b251bd6fe6175b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1d1449-6119-435c-b46c-c64ef6643d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1d1449-6119-435c-b46c-c64ef6643d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de3ec60-1454-4c87-9531-624483b3864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de3ec60-1454-4c87-9531-624483b3864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bcf8407-5824-44f4-a208-b1d96082e668', 'volume_name': 'volume-9bcf8407-5824-44f4-a208-b1d96082e668', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b9591b-ed3b-4212-83b9-23be73a86517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b9591b-ed3b-4212-83b9-23be73a86517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd63354-d121-4058-9951-061c84146891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:30 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Volume 9bcf8407-5824-44f4-a208-b1d96082e668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bcf8407-5824-44f4-a208-b1d96082e668', 'volume_size': 1} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-114143382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcf8407-5824-44f4-a208-b1d96082e668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b55bd3027041d59db0e8eb009bdacf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:11:31Z,use_quota=True,user_id='246da05cc7954211b251bd6fe6175b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Creating volume 9bcf8407-5824-44f4-a208-b1d96082e668 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:11:30 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:11:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:30 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668 1073741824 Aug 01 15:11:30 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:31 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668 1073741824" returned: 0 in 0.504s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:31 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668 Aug 01 15:11:31 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:31 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668" returned: 0 in 0.309s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:11:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd63354-d121-4058-9951-061c84146891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bcf8407-5824-44f4-a208-b1d96082e668', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e48c56-8249-44e8-b5a6-b74de2a91bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:31 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Volume volume-9bcf8407-5824-44f4-a208-b1d96082e668 (9bcf8407-5824-44f4-a208-b1d96082e668): created successfully Aug 01 15:11:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e48c56-8249-44e8-b5a6-b74de2a91bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Flow 'volume_create_manager' (6c4a52f5-e593-4836-b732-c7b8860cdac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:31 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-418abfb2-b914-445c-b412-3e070f88cb50 tempest-VolumeQuotasAdminTestJSON-1281168768 None] Created volume successfully. Aug 01 15:11:33 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ebfd53d0-5656-4df1-af16-3c9b185e47ec tempest-VolumeQuotasAdminTestJSON-1513743066 None] Transfer volume completed successfully. Aug 01 15:11:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Acquiring lock "cinder-9bcf8407-5824-44f4-a208-b1d96082e668-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Lock "cinder-9bcf8407-5824-44f4-a208-b1d96082e668-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Acquiring lock "cinder-quobyte-9bcf8407-5824-44f4-a208-b1d96082e668" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Lock "cinder-quobyte-9bcf8407-5824-44f4-a208-b1d96082e668" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:34 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dda169d-87a1-49be-8946-48b7af203d4f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:34 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668 Aug 01 15:11:34 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:34 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668" returned: 0 in 0.380s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:34 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668 Aug 01 15:11:34 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:34 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9bcf8407-5824-44f4-a208-b1d96082e668" returned: 0 in 0.325s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Lock "cinder-quobyte-9bcf8407-5824-44f4-a208-b1d96082e668" released by "delete_volume" :: held 0.751s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:35 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Created reservations ['ca70112d-40d2-40b3-9853-d83dfb6e951c', '33faa6e9-a677-46ad-b73d-260e4a5c21c3', '402808f6-b28b-4c24-8edd-abca462e6559', '2d449ed5-3622-46e3-a57b-5c82ec4f08e7'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:35 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:11:35 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:35 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.267s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:35 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:11:35 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Deleted volume successfully. Aug 01 15:11:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5eeb6377-6ae5-4618-96e1-36ac1ef687a9 tempest-VolumeQuotasAdminTestJSON-567474162 None] Lock "cinder-9bcf8407-5824-44f4-a208-b1d96082e668-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=126,cinder:SELECT=119,cinder:INSERT=33,cinder:DELETE=7 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=90,cinder:UPDATE=129,cinder:INSERT=35,cinder:DELETE=13 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Flow 'volume_create_manager' (6626ba70-937f-415f-aeb0-2de8d46e93fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5b9003-83ec-420a-a1ee-dc6057ed5451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5b9003-83ec-420a-a1ee-dc6057ed5451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1897462206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2e3f91-1afc-4c9a-a023-ea83bc14a445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7f7be0a4484d91b74c15afda5e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:11:43Z,use_quota=True,user_id='f3eee546000f46eea64c39f40861fbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbbb953-973f-41d4-abbf-fc691f180b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbbb953-973f-41d4-abbf-fc691f180b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6fcbed-ff35-47cd-ad45-1bec43346874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6fcbed-ff35-47cd-ad45-1bec43346874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2e3f91-1afc-4c9a-a023-ea83bc14a445', 'volume_name': 'volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149f1b8c-1d1a-4cd8-b092-7e38f59380e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149f1b8c-1d1a-4cd8-b092-7e38f59380e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42750a7d-94a7-4e91-82a8-3b58e107b691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:43 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Volume be2e3f91-1afc-4c9a-a023-ea83bc14a445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445', 'volume_size': 1} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1897462206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2e3f91-1afc-4c9a-a023-ea83bc14a445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1a7f7be0a4484d91b74c15afda5e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:11:43Z,use_quota=True,user_id='f3eee546000f46eea64c39f40861fbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Creating volume be2e3f91-1afc-4c9a-a023-ea83bc14a445 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:11:43 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:11:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:43 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445 1073741824 Aug 01 15:11:43 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:44 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445 1073741824" returned: 0 in 0.521s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:44 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445 Aug 01 15:11:44 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:44 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445" returned: 0 in 0.373s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42750a7d-94a7-4e91-82a8-3b58e107b691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3b53b1-689e-4ed4-b08d-d91f747484ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:44 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Volume volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445 (be2e3f91-1afc-4c9a-a023-ea83bc14a445): created successfully Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3b53b1-689e-4ed4-b08d-d91f747484ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Flow 'volume_create_manager' (6626ba70-937f-415f-aeb0-2de8d46e93fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:44 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-49bbcdd3-dc64-4b46-af28-e39ddf3ad262 tempest-VolumesServicesTestJSON-1361445680 None] Created volume successfully. Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-4bb74844-c64c-4316-9815-868048be1e0c req-fd9fa2fd-1af1-477c-ade6-ff2abfe6756f tempest-TestStampPattern-519944343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-4bb74844-c64c-4316-9815-868048be1e0c req-fd9fa2fd-1af1-477c-ade6-ff2abfe6756f tempest-TestStampPattern-519944343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-4bb74844-c64c-4316-9815-868048be1e0c req-fd9fa2fd-1af1-477c-ade6-ff2abfe6756f tempest-TestStampPattern-519944343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-4bb74844-c64c-4316-9815-868048be1e0c req-fd9fa2fd-1af1-477c-ade6-ff2abfe6756f tempest-TestStampPattern-519944343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-7756b121-f44e-485f-a2cd-3257ebf28540', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7fe38fa-85bc-4b60-ad68-96dfaea53a0f', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:11:44 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-4bb74844-c64c-4316-9815-868048be1e0c req-fd9fa2fd-1af1-477c-ade6-ff2abfe6756f tempest-TestStampPattern-519944343 None] attachment_update completed successfully. Aug 01 15:11:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Acquiring lock "cinder-be2e3f91-1afc-4c9a-a023-ea83bc14a445-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Lock "cinder-be2e3f91-1afc-4c9a-a023-ea83bc14a445-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Acquiring lock "cinder-quobyte-be2e3f91-1afc-4c9a-a023-ea83bc14a445" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Lock "cinder-quobyte-be2e3f91-1afc-4c9a-a023-ea83bc14a445" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:45 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[547c21b3-0548-46cd-991d-068577ba51cb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:46 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445 Aug 01 15:11:46 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:46 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445" returned: 0 in 0.386s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:46 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445 Aug 01 15:11:46 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:46 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be2e3f91-1afc-4c9a-a023-ea83bc14a445" returned: 0 in 0.272s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Lock "cinder-quobyte-be2e3f91-1afc-4c9a-a023-ea83bc14a445" released by "delete_volume" :: held 0.707s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:46 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Created reservations ['5cc62ab4-a39a-4ff1-8d63-815679c1d611', '971cc393-d31a-436d-9d09-e5cb00920593', 'e0689dc2-6c4b-4ccc-984d-c3d43e53cbd3', 'ffd5b21d-a6db-467f-87a5-d8941929dad0'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:46 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:11:46 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:47 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.411s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:47 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:11:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Deleted volume successfully. Aug 01 15:11:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38b64338-29d6-4174-96c7-c7a57aca8159 tempest-VolumesServicesTestJSON-1361445680 None] Lock "cinder-be2e3f91-1afc-4c9a-a023-ea83bc14a445-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-c028e714-56c5-445b-83e6-d28054553d11 req-e49642f6-6ac8-4d5a-b28e-01ed73923235 tempest-TestStampPattern-519944343 None] Terminate volume connection completed successfully. Aug 01 15:11:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c028e714-56c5-445b-83e6-d28054553d11 req-e49642f6-6ac8-4d5a-b28e-01ed73923235 tempest-TestStampPattern-519944343 None] Deleting attachment b7fe38fa-85bc-4b60-ad68-96dfaea53a0f. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:11:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] Creating offline snapshot f28b2363-c4aa-410b-84d6-6bd505dbd98e of volume 7756b121-f44e-485f-a2cd-3257ebf28540 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:11:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e93a74f-c005-4fd6-b8b4-bbb53e586a47]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:52 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 Aug 01 15:11:52 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:52 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540" returned: 0 in 0.460s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:52 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e 1G Aug 01 15:11:52 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:52 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e 1G" returned: 0 in 0.449s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7756b121-f44e-485f-a2cd-3257ebf28540 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:52 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7756b121-f44e-485f-a2cd-3257ebf28540 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e Aug 01 15:11:52 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:53 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7756b121-f44e-485f-a2cd-3257ebf28540 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e" returned: 0 in 0.358s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:53 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e is being set with open permissions: ugo+rw Aug 01 15:11:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:53 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e Aug 01 15:11:53 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:53 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e" returned: 0 in 0.268s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:53 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.info Aug 01 15:11:53 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:53 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.info" returned: 0 in 0.286s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:53 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.info is being set with open permissions: ugo+rw Aug 01 15:11:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:53 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.info Aug 01 15:11:53 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:54 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.info" returned: 0 in 0.260s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-821ffe68-aeef-45b0-89b8-aa4da80b3640 tempest-TestStampPattern-519944343 None] Create snapshot completed successfully Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Flow 'volume_create_manager' (7d804f7f-82b6-4de0-9d5c-d51c0c5bbac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d28ccf-0345-4d46-912b-6befab63a886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d28ccf-0345-4d46-912b-6befab63a886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-888231528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b11da87-46f9-40cf-ab5d-e18b2b80e6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62352e1cd5a9465f8964374a2d4b3ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:11:55Z,use_quota=True,user_id='79646a95f3ef4d448098d37670b963a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d66d1798-c871-4bb7-901b-ddca8629d8c9),volume_type_id=d66d1798-c871-4bb7-901b-ddca8629d8c9)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (140663a9-d81b-4059-99f1-4da6392f3706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (140663a9-d81b-4059-99f1-4da6392f3706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daacc201-ecf6-4deb-9222-3fce7967bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daacc201-ecf6-4deb-9222-3fce7967bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b11da87-46f9-40cf-ab5d-e18b2b80e6fa', 'volume_name': 'volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b91827-2ad5-4a9e-b709-4af046b62d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b91827-2ad5-4a9e-b709-4af046b62d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d12745c-cbf7-44c7-a3d2-d11dd8f11efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:55 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Volume 7b11da87-46f9-40cf-ab5d-e18b2b80e6fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa', 'volume_size': 1} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-888231528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b11da87-46f9-40cf-ab5d-e18b2b80e6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62352e1cd5a9465f8964374a2d4b3ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:11:55Z,use_quota=True,user_id='79646a95f3ef4d448098d37670b963a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d66d1798-c871-4bb7-901b-ddca8629d8c9),volume_type_id=d66d1798-c871-4bb7-901b-ddca8629d8c9)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Creating volume 7b11da87-46f9-40cf-ab5d-e18b2b80e6fa {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:11:55 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:11:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:55 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa 1073741824 Aug 01 15:11:55 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:56 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa 1073741824" returned: 0 in 0.585s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:56 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa Aug 01 15:11:56 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:56 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa" returned: 0 in 0.331s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:11:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d12745c-cbf7-44c7-a3d2-d11dd8f11efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d20051-e04e-4715-9fcf-f7785809a4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:11:56 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Volume volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa (7b11da87-46f9-40cf-ab5d-e18b2b80e6fa): created successfully Aug 01 15:11:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d20051-e04e-4715-9fcf-f7785809a4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:11:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Flow 'volume_create_manager' (7d804f7f-82b6-4de0-9d5c-d51c0c5bbac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:11:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-546ed1c0-e4ff-4ebf-a41d-db450c1c3177 tempest-VolumeTypesAccessTest-1200512695 None] Created volume successfully. Aug 01 15:11:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Acquiring lock "cinder-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Lock "cinder-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Acquiring lock "cinder-quobyte-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:11:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Lock "cinder-quobyte-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:11:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd14a5a-958d-4005-a5c4-919a1e169b8b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:11:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:57 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa Aug 01 15:11:57 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:58 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa" returned: 0 in 0.468s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:58 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa Aug 01 15:11:58 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:58 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa" returned: 0 in 0.308s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Lock "cinder-quobyte-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa" released by "delete_volume" :: held 0.835s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:11:58 devstack cinder-volume[89024]: WARNING cinder.quota [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-916566050 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-916566050, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:11:58 devstack cinder-volume[89024]: WARNING cinder.quota [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-916566050 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-916566050, it is now deprecated. Please use the default quota class for default quota. Aug 01 15:11:58 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Created reservations ['98a655a5-f7b9-4cdd-8153-3a752430b5d6', '82972cca-b486-4cab-9896-20ff1bc99bbb', '62b0d78d-2d96-42e1-9ed1-b3050cebd7c2', '0048feb3-5065-47c0-8c7b-8b230f7c2709'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:11:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:11:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:11:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:11:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:11:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:11:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:11:58 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:11:58 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:11:59 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Aug 01 15:11:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.466s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:11:59 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:11:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Deleted volume successfully. Aug 01 15:11:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40bc5b19-3267-46d7-83ad-eaa766aa47ba tempest-VolumeTypesAccessTest-1200512695 None] Lock "cinder-7b11da87-46f9-40cf-ab5d-e18b2b80e6fa-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:12:04 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Flow 'volume_create_manager' (942602be-7f2d-4c0c-b406-aef8eeb90946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d150817-977e-42af-bfce-97535140da97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d150817-977e-42af-bfce-97535140da97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-720015743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b70593-91d7-44ec-8fb7-129bba05e10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c77a0e314eb4db5be209ae27e60328a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f28b2363-c4aa-410b-84d6-6bd505dbd98e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:12:05Z,use_quota=True,user_id='37cc0ebc232d4341b865a9b011252f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd64a64-7b21-4784-add0-b9f2115be62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd64a64-7b21-4784-add0-b9f2115be62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccec57f-75fc-4df6-b017-275756709c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccec57f-75fc-4df6-b017-275756709c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44b70593-91d7-44ec-8fb7-129bba05e10a', 'volume_name': 'volume-44b70593-91d7-44ec-8fb7-129bba05e10a', 'volume_size': 1, 'snapshot_id': 'f28b2363-c4aa-410b-84d6-6bd505dbd98e'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5327100c-0479-4f49-8a4d-5f36ee231d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5327100c-0479-4f49-8a4d-5f36ee231d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de19727a-a26e-4a12-bdd6-1faa760f7beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:05 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Volume 44b70593-91d7-44ec-8fb7-129bba05e10a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44b70593-91d7-44ec-8fb7-129bba05e10a', 'volume_size': 1, 'snapshot_id': 'f28b2363-c4aa-410b-84d6-6bd505dbd98e'} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Acquiring lock "cinder-quobyte-f28b2363-c4aa-410b-84d6-6bd505dbd98e-44b70593-91d7-44ec-8fb7-129bba05e10a" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-f28b2363-c4aa-410b-84d6-6bd505dbd98e-44b70593-91d7-44ec-8fb7-129bba05e10a" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Creating volume 44b70593-91d7-44ec-8fb7-129bba05e10a from snapshot f28b2363-c4aa-410b-84d6-6bd505dbd98e {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Acquiring lock "cinder-quobyte-44b70593-91d7-44ec-8fb7-129bba05e10a" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-44b70593-91d7-44ec-8fb7-129bba05e10a" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] snapshot: f28b2363-c4aa-410b-84d6-6bd505dbd98e, volume: 44b70593-91d7-44ec-8fb7-129bba05e10a, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd08e907-e9e2-472a-97ce-fdf1aa7a546f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:12:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:05 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e Aug 01 15:12:05 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:06 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Aug 01 15:12:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e" returned: 0 in 0.756s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7756b121-f44e-485f-a2cd-3257ebf28540(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:12:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0372aa94-1dc7-4f6a-9852-57b7a0142029]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:12:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:06 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 Aug 01 15:12:06 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540" returned: 0 in 0.865s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:12:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:12:07 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Aug 01 15:12:07 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:12:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:07 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a Aug 01 15:12:07 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:10 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:12:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Flow 'volume_create_manager' (1f38ebe9-4fe7-4617-9e3b-b64fd2f881b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:12:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008095b8-910a-4dd0-889c-5dce126b8bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008095b8-910a-4dd0-889c-5dce126b8bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-430044574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b333c388-e9f8-4726-a92e-4aa47f701609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11245fc9a83a4ea3ab9967f013446924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:12:11Z,use_quota=True,user_id='b619ae8951c4480b919886d165fa53ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1e4182-b748-40b8-87ab-9ebbf340d64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1e4182-b748-40b8-87ab-9ebbf340d64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443688c8-61ed-4a84-bda8-ce63b03fafe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443688c8-61ed-4a84-bda8-ce63b03fafe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b333c388-e9f8-4726-a92e-4aa47f701609', 'volume_name': 'volume-b333c388-e9f8-4726-a92e-4aa47f701609', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70401512-6827-476a-a6a1-620ca09638c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70401512-6827-476a-a6a1-620ca09638c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c6ec3f-f3d3-4b39-be3c-bdf8d5607ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:11 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Volume b333c388-e9f8-4726-a92e-4aa47f701609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b333c388-e9f8-4726-a92e-4aa47f701609', 'volume_size': 1} Aug 01 15:12:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a" returned: 0 in 9.299s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540, size 1024.00 MB, duration 9.30 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:12:16 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Converted 1024.00 MB image at 110.11 MB/s Aug 01 15:12:16 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a is being set with open permissions: ugo+rw Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:16 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a Aug 01 15:12:16 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:16 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a" returned: 0 in 0.526s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-44b70593-91d7-44ec-8fb7-129bba05e10a" released by "_copy_volume_from_snapshot" :: held 11.636s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-f28b2363-c4aa-410b-84d6-6bd505dbd98e-44b70593-91d7-44ec-8fb7-129bba05e10a" released by "_create_volume_from_snapshot" :: held 11.776s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.814s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.650s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-430044574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b333c388-e9f8-4726-a92e-4aa47f701609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11245fc9a83a4ea3ab9967f013446924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:12:11Z,use_quota=True,user_id='b619ae8951c4480b919886d165fa53ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Creating volume b333c388-e9f8-4726-a92e-4aa47f701609 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:12:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:12:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:12:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:12:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:12:17 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:12:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:17 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609 1073741824 Aug 01 15:12:17 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de19727a-a26e-4a12-bdd6-1faa760f7beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b70593-91d7-44ec-8fb7-129bba05e10a', 'volume_size': 1, 'snapshot_id': 'f28b2363-c4aa-410b-84d6-6bd505dbd98e'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac940f58-b0da-4a2b-98ec-69fda3daceff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:17 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Volume volume-44b70593-91d7-44ec-8fb7-129bba05e10a (44b70593-91d7-44ec-8fb7-129bba05e10a): created successfully Aug 01 15:12:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac940f58-b0da-4a2b-98ec-69fda3daceff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Flow 'volume_create_manager' (942602be-7f2d-4c0c-b406-aef8eeb90946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:12:17 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-75458f0c-a0f9-47ba-94c9-20ed90b0aa66 tempest-TestStampPattern-519944343 None] Created volume successfully. Aug 01 15:12:17 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Aug 01 15:12:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609 1073741824" returned: 0 in 0.972s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:18 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609 Aug 01 15:12:18 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:18 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609" returned: 0 in 0.376s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c6ec3f-f3d3-4b39-be3c-bdf8d5607ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b333c388-e9f8-4726-a92e-4aa47f701609', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b2bcfe-f813-42ed-b923-ca353e7d8180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:18 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Volume volume-b333c388-e9f8-4726-a92e-4aa47f701609 (b333c388-e9f8-4726-a92e-4aa47f701609): created successfully Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b2bcfe-f813-42ed-b923-ca353e7d8180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Flow 'volume_create_manager' (1f38ebe9-4fe7-4617-9e3b-b64fd2f881b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:12:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7e75044a-fac5-4d23-99a4-87c63842890f tempest-TestMinimumBasicScenario-470039605 None] Created volume successfully. Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:18 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:12:18 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:18 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.413s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:12:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:12:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:12:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:12:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-893a8794-72fa-4416-8e42-7fe4f4feba31 req-f2ca0330-c28e-4e80-8fd4-8782f713b047 tempest-TestMinimumBasicScenario-470039605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:12:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-893a8794-72fa-4416-8e42-7fe4f4feba31 req-f2ca0330-c28e-4e80-8fd4-8782f713b047 tempest-TestMinimumBasicScenario-470039605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:12:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-893a8794-72fa-4416-8e42-7fe4f4feba31 req-f2ca0330-c28e-4e80-8fd4-8782f713b047 tempest-TestMinimumBasicScenario-470039605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:12:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-893a8794-72fa-4416-8e42-7fe4f4feba31 req-f2ca0330-c28e-4e80-8fd4-8782f713b047 tempest-TestMinimumBasicScenario-470039605 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-b333c388-e9f8-4726-a92e-4aa47f701609', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbf8f1ca-b8a6-463c-9d71-78b1e05c2a50', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:12:21 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-893a8794-72fa-4416-8e42-7fe4f4feba31 req-f2ca0330-c28e-4e80-8fd4-8782f713b047 tempest-TestMinimumBasicScenario-470039605 None] attachment_update completed successfully. Aug 01 15:12:31 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=41,cinder:INSERT=4,cinder:UPDATE=27,cinder:DELETE=4 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:12:31 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=32,cinder:UPDATE=37,cinder:DELETE=3,cinder:INSERT=9 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:12:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c83b8a47-0e09-4f6d-b264-9b591cb622e0 req-1f3f313f-7c8b-4ab1-8ee8-bba9612b6b69 tempest-TestStampPattern-519944343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:12:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c83b8a47-0e09-4f6d-b264-9b591cb622e0 req-1f3f313f-7c8b-4ab1-8ee8-bba9612b6b69 tempest-TestStampPattern-519944343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:12:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-c83b8a47-0e09-4f6d-b264-9b591cb622e0 req-1f3f313f-7c8b-4ab1-8ee8-bba9612b6b69 tempest-TestStampPattern-519944343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:12:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-c83b8a47-0e09-4f6d-b264-9b591cb622e0 req-1f3f313f-7c8b-4ab1-8ee8-bba9612b6b69 tempest-TestStampPattern-519944343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-44b70593-91d7-44ec-8fb7-129bba05e10a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f5bec2e-0087-4526-b553-7ede197b78ad', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:12:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-c83b8a47-0e09-4f6d-b264-9b591cb622e0 req-1f3f313f-7c8b-4ab1-8ee8-bba9612b6b69 tempest-TestStampPattern-519944343 None] attachment_update completed successfully. Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (bb4e76d2-465e-4c24-b667-feb7fe774559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7145427-cb0c-4cd5-956d-b3b60639c460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7145427-cb0c-4cd5-956d-b3b60639c460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-350833507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4732dd3d-0000-4193-b022-3870eddbae0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:12:52Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a13e974-e941-4706-a0ba-4bc917e1a8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a13e974-e941-4706-a0ba-4bc917e1a8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e06792-0fed-44d3-aaad-1480f55e2387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e06792-0fed-44d3-aaad-1480f55e2387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4732dd3d-0000-4193-b022-3870eddbae0e', 'volume_name': 'volume-4732dd3d-0000-4193-b022-3870eddbae0e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9963362b-79a3-4277-bf05-a0181c06d567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9963362b-79a3-4277-bf05-a0181c06d567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778f182c-1835-430b-a91d-4ee1601fd441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Volume 4732dd3d-0000-4193-b022-3870eddbae0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4732dd3d-0000-4193-b022-3870eddbae0e', 'volume_size': 1} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-350833507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4732dd3d-0000-4193-b022-3870eddbae0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:12:52Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Creating volume 4732dd3d-0000-4193-b022-3870eddbae0e {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:12:52 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:12:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:52 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e 1073741824 Aug 01 15:12:52 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:53 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Aug 01 15:12:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e 1073741824" returned: 0 in 0.557s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:53 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e Aug 01 15:12:53 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:53 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Aug 01 15:12:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e" returned: 0 in 0.264s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:12:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:12:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778f182c-1835-430b-a91d-4ee1601fd441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4732dd3d-0000-4193-b022-3870eddbae0e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b6b9ca-b651-457f-b0da-5711213a259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:12:53 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Volume volume-4732dd3d-0000-4193-b022-3870eddbae0e (4732dd3d-0000-4193-b022-3870eddbae0e): created successfully Aug 01 15:12:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b6b9ca-b651-457f-b0da-5711213a259d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:12:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (bb4e76d2-465e-4c24-b667-feb7fe774559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:12:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f917e30a-c8df-42c2-bbe6-b6dc9e3b1534 tempest-VolumesActionsTest-457079154 None] Created volume successfully. Aug 01 15:12:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1a179d61-9d83-46cd-a5c1-56e2c46a053a tempest-VolumesActionsTest-457079154 None] Acquiring lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e" by "attach_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:12:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1a179d61-9d83-46cd-a5c1-56e2c46a053a tempest-VolumesActionsTest-457079154 None] Lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e" acquired by "attach_volume" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:12:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1a179d61-9d83-46cd-a5c1-56e2c46a053a tempest-VolumesActionsTest-457079154 None] Attaching volume 4732dd3d-0000-4193-b022-3870eddbae0e to instance f04ac2cd-369f-4dc7-88f0-c9212fbbcee6 at mountpoint /dev/vdb on host None. Aug 01 15:12:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1a179d61-9d83-46cd-a5c1-56e2c46a053a tempest-VolumesActionsTest-457079154 None] Attach volume completed successfully. Aug 01 15:12:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1a179d61-9d83-46cd-a5c1-56e2c46a053a tempest-VolumesActionsTest-457079154 None] Lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e" released by "attach_volume" :: held 0.146s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:12:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-45fd65f1-df6c-4a4a-8902-1e016b65bb71 tempest-VolumesActionsTest-1088664175 None] Terminate volume connection completed successfully. Aug 01 15:12:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45fd65f1-df6c-4a4a-8902-1e016b65bb71 tempest-VolumesActionsTest-1088664175 None] Acquiring lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e-detach_volume" by "detach_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:12:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45fd65f1-df6c-4a4a-8902-1e016b65bb71 tempest-VolumesActionsTest-1088664175 None] Lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:12:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-45fd65f1-df6c-4a4a-8902-1e016b65bb71 tempest-VolumesActionsTest-1088664175 None] Detaching volume 4732dd3d-0000-4193-b022-3870eddbae0e from instance f04ac2cd-369f-4dc7-88f0-c9212fbbcee6. Aug 01 15:12:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-eaf14742-27ef-4be0-a5c2-04665dadf6f5 req-621a524c-7f24-4cf3-8ad6-0b5c7edfba9f tempest-TestStampPattern-519944343 None] Terminate volume connection completed successfully. Aug 01 15:12:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-eaf14742-27ef-4be0-a5c2-04665dadf6f5 req-621a524c-7f24-4cf3-8ad6-0b5c7edfba9f tempest-TestStampPattern-519944343 None] Deleting attachment 7f5bec2e-0087-4526-b553-7ede197b78ad. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:12:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-45fd65f1-df6c-4a4a-8902-1e016b65bb71 tempest-VolumesActionsTest-1088664175 None] Detach volume completed successfully. Aug 01 15:12:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-45fd65f1-df6c-4a4a-8902-1e016b65bb71 tempest-VolumesActionsTest-1088664175 None] Lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:12:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a2c0867-a3d3-40ae-a331-b1a3e73dc11c tempest-VolumesActionsTest-457079154 None] Acquiring lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e-detach_volume" by "detach_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:12:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a2c0867-a3d3-40ae-a331-b1a3e73dc11c tempest-VolumesActionsTest-457079154 None] Lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:12:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7a2c0867-a3d3-40ae-a331-b1a3e73dc11c tempest-VolumesActionsTest-457079154 None] Volume detach called, but volume not attached. Aug 01 15:12:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a2c0867-a3d3-40ae-a331-b1a3e73dc11c tempest-VolumesActionsTest-457079154 None] Lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:12:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Acquiring lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:12:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:12:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Acquiring lock "cinder-quobyte-4732dd3d-0000-4193-b022-3870eddbae0e" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:12:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Lock "cinder-quobyte-4732dd3d-0000-4193-b022-3870eddbae0e" acquired by "delete_volume" :: waited 0.051s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:12:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[806afe8f-8797-442e-a31d-babfc6119e5c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:12:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:56 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e Aug 01 15:12:56 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:57 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Aug 01 15:12:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e" returned: 0 in 1.055s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:57 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e Aug 01 15:12:57 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:58 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Aug 01 15:12:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4732dd3d-0000-4193-b022-3870eddbae0e" returned: 0 in 0.692s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Lock "cinder-quobyte-4732dd3d-0000-4193-b022-3870eddbae0e" released by "delete_volume" :: held 1.829s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:12:58 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Created reservations ['78825fcf-9742-4ed0-a999-7f19484d04ab', 'd7f1ab25-2ae8-4896-9c24-5d3446a48e40', '5bb0d824-21f8-40bd-9b49-5601e5318ac2', '759e231d-dc37-41ae-bc42-f864dbb7096b'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:12:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:12:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:12:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:12:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:12:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:12:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:12:58 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:12:58 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:12:59 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Aug 01 15:12:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.921s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:12:59 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:12:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Deleted volume successfully. Aug 01 15:12:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-404165b5-3312-4c68-bf03-225cbeccfcbd tempest-VolumesActionsTest-457079154 None] Lock "cinder-4732dd3d-0000-4193-b022-3870eddbae0e-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Acquiring lock "cinder-44b70593-91d7-44ec-8fb7-129bba05e10a-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Lock "cinder-44b70593-91d7-44ec-8fb7-129bba05e10a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Acquiring lock "cinder-quobyte-44b70593-91d7-44ec-8fb7-129bba05e10a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-44b70593-91d7-44ec-8fb7-129bba05e10a" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:02 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a79d45-b461-42b7-9b3a-4473daa70675]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:03 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a Aug 01 15:13:03 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:03 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a" returned: 0 in 0.412s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:03 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a Aug 01 15:13:03 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:03 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44b70593-91d7-44ec-8fb7-129bba05e10a" returned: 0 in 0.289s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-44b70593-91d7-44ec-8fb7-129bba05e10a" released by "delete_volume" :: held 0.740s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Created reservations ['793c0e1d-3071-4c8c-b3ff-84ce21aa021b', 'cf6ba1b5-038d-4ecf-b4c6-f0b82e29e008', '42387a25-0ada-478a-ab65-25a865a0687d', '199b2f0b-27fa-46f3-95af-acf9228affae'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (7acbb5c2-4961-4416-a906-80f441b0a15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f64af9-0f31-4f38-b332-53e8804ba716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f64af9-0f31-4f38-b332-53e8804ba716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-22588226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82127a9-1b70-4d4e-b8eb-06e3f53bc414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:04Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfd9568-305b-4354-a281-b4c1cea2aed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfd9568-305b-4354-a281-b4c1cea2aed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787014c6-20f5-439f-a9aa-f0e9e916ae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787014c6-20f5-439f-a9aa-f0e9e916ae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c82127a9-1b70-4d4e-b8eb-06e3f53bc414', 'volume_name': 'volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e92a4e6-e3e0-4124-adeb-6fe723ada638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e92a4e6-e3e0-4124-adeb-6fe723ada638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e9f445-459d-4fd9-839c-b14bc56d906f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Volume c82127a9-1b70-4d4e-b8eb-06e3f53bc414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414', 'volume_size': 1} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-22588226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c82127a9-1b70-4d4e-b8eb-06e3f53bc414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:04Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Creating volume c82127a9-1b70-4d4e-b8eb-06e3f53bc414 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:13:03 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:03 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414 1073741824 Aug 01 15:13:03 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:03 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:13:03 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:04 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.280s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:13:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Deleted volume successfully. Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8d2acb2c-7242-43af-af43-5609329b1ab1 tempest-TestStampPattern-519944343 None] Lock "cinder-44b70593-91d7-44ec-8fb7-129bba05e10a-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Acquiring lock "cinder-f28b2363-c4aa-410b-84d6-6bd505dbd98e-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:04 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414 1073741824" returned: 0 in 0.500s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Lock "cinder-f28b2363-c4aa-410b-84d6-6bd505dbd98e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Acquiring lock "cinder-quobyte-7756b121-f44e-485f-a2cd-3257ebf28540" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-7756b121-f44e-485f-a2cd-3257ebf28540" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Acquiring lock "cinder-quobyte-f28b2363-c4aa-410b-84d6-6bd505dbd98e" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-f28b2363-c4aa-410b-84d6-6bd505dbd98e" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Deleting offline snapshot f28b2363-c4aa-410b-84d6-6bd505dbd98e of volume 7756b121-f44e-485f-a2cd-3257ebf28540 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:13:04 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414 Aug 01 15:13:04 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] snapshot_file for this snap is: volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7685a11a-c6ea-4d4d-899a-f3d9175c9f64]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:04 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e Aug 01 15:13:04 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:04 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414" returned: 0 in 0.278s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e9f445-459d-4fd9-839c-b14bc56d906f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5273955-cedc-466b-9e4f-d370e1118a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:04 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Volume volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414 (c82127a9-1b70-4d4e-b8eb-06e3f53bc414): created successfully Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5273955-cedc-466b-9e4f-d370e1118a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (7acbb5c2-4961-4416-a906-80f441b0a15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-11a7bc46-ca0e-4cb7-82df-86a8d740b9f5 tempest-VolumesActionsTest-457079154 None] Created volume successfully. Aug 01 15:13:04 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e" returned: 0 in 0.385s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7756b121-f44e-485f-a2cd-3257ebf28540(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[207baec4-76ec-4660-ae31-c6c00b45e1f1]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:04 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 Aug 01 15:13:04 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:05 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540" returned: 0 in 0.547s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:05 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e Aug 01 15:13:05 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:05 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e" returned: 0 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:05 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e Aug 01 15:13:05 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Acquiring lock "cinder-c82127a9-1b70-4d4e-b8eb-06e3f53bc414-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Lock "cinder-c82127a9-1b70-4d4e-b8eb-06e3f53bc414-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Acquiring lock "cinder-quobyte-c82127a9-1b70-4d4e-b8eb-06e3f53bc414" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:05 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540.f28b2363-c4aa-410b-84d6-6bd505dbd98e" returned: 0 in 0.263s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Lock "cinder-quobyte-c82127a9-1b70-4d4e-b8eb-06e3f53bc414" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca28b0d-c2c3-4b33-ae94-fe7d80ffc3ae]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-f28b2363-c4aa-410b-84d6-6bd505dbd98e" released by "_delete_snapshot" :: held 1.665s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-7756b121-f44e-485f-a2cd-3257ebf28540" released by "delete_snapshot" :: held 1.711s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Created reservations ['ddd7968d-10f3-4ea7-8039-f1025b4f76f2', '4c46a55f-2ab1-4963-8678-6da195cfbc10', '560b8b88-f3f8-4426-907d-38f8d72be61b', '4e1fc5c4-6f28-4538-ad0b-8e9ff2290de8'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:13:06 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414 Aug 01 15:13:06 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:06 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Delete snapshot completed successfully. Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4b8f9190-ce69-4c60-894a-fa7e601f5e27 tempest-TestStampPattern-519944343 None] Lock "cinder-f28b2363-c4aa-410b-84d6-6bd505dbd98e-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:06 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414" returned: 0 in 0.364s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:06 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414 Aug 01 15:13:06 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:06 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c82127a9-1b70-4d4e-b8eb-06e3f53bc414" returned: 0 in 0.256s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Lock "cinder-quobyte-c82127a9-1b70-4d4e-b8eb-06e3f53bc414" released by "delete_volume" :: held 0.675s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Created reservations ['75b71e83-ac2b-4a1d-b2e6-1d5b2013b5ee', '9f45ab8a-c145-4283-925d-5f19ad829956', '8e1655e2-a422-4656-8cb9-5fa67165aec3', '0f3da875-5520-43e0-8a8d-42954c1b7daf'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:06 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:13:06 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:07 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.302s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:13:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Deleted volume successfully. Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7454ddc5-d23f-4a32-8106-68768024c6ae tempest-VolumesActionsTest-1088664175 None] Lock "cinder-c82127a9-1b70-4d4e-b8eb-06e3f53bc414-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (5d2dc687-4a9c-4b99-869d-bce551cef537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb3b14b-141e-40ae-ad8e-96ea1524a11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb3b14b-141e-40ae-ad8e-96ea1524a11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-496657383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2012e869-ccb0-417e-85de-814662c0871a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:08Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afc5c69-be57-41ae-b8ae-9cc6a6d02186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afc5c69-be57-41ae-b8ae-9cc6a6d02186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c6eccd-dd0f-46e9-ad50-a9828e663f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c6eccd-dd0f-46e9-ad50-a9828e663f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2012e869-ccb0-417e-85de-814662c0871a', 'volume_name': 'volume-2012e869-ccb0-417e-85de-814662c0871a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4016c67e-5b41-4d92-84d7-9c765b754c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4016c67e-5b41-4d92-84d7-9c765b754c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436a5108-254e-47b4-87c7-8ff6ecd9f6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:07 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Volume 2012e869-ccb0-417e-85de-814662c0871a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2012e869-ccb0-417e-85de-814662c0871a', 'volume_size': 1} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-496657383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2012e869-ccb0-417e-85de-814662c0871a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:08Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Creating volume 2012e869-ccb0-417e-85de-814662c0871a {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:13:07 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:13:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:07 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a 1073741824 Aug 01 15:13:07 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:08 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a 1073741824" returned: 0 in 0.589s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:08 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a Aug 01 15:13:08 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:08 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a" returned: 0 in 0.286s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:13:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436a5108-254e-47b4-87c7-8ff6ecd9f6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2012e869-ccb0-417e-85de-814662c0871a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9047b7a4-1b05-421c-bffc-ae541975b298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:08 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Volume volume-2012e869-ccb0-417e-85de-814662c0871a (2012e869-ccb0-417e-85de-814662c0871a): created successfully Aug 01 15:13:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9047b7a4-1b05-421c-bffc-ae541975b298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (5d2dc687-4a9c-4b99-869d-bce551cef537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-64ff9b75-5529-4e14-b553-c53020f6878b tempest-VolumesActionsTest-457079154 None] Created volume successfully. Aug 01 15:13:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Acquiring lock "cinder-2012e869-ccb0-417e-85de-814662c0871a-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Lock "cinder-2012e869-ccb0-417e-85de-814662c0871a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Acquiring lock "cinder-quobyte-2012e869-ccb0-417e-85de-814662c0871a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Lock "cinder-quobyte-2012e869-ccb0-417e-85de-814662c0871a" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[24859f36-a6a5-42c3-9762-60cc22ffa47c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:10 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a Aug 01 15:13:10 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Acquiring lock "cinder-7756b121-f44e-485f-a2cd-3257ebf28540-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Lock "cinder-7756b121-f44e-485f-a2cd-3257ebf28540-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Acquiring lock "cinder-quobyte-7756b121-f44e-485f-a2cd-3257ebf28540" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-7756b121-f44e-485f-a2cd-3257ebf28540" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c048e8f-1ea2-43ab-99c9-b2975335b14c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:10 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a" returned: 0 in 0.447s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:10 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a Aug 01 15:13:10 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:10 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 Aug 01 15:13:10 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:10 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2012e869-ccb0-417e-85de-814662c0871a" returned: 0 in 0.275s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Lock "cinder-quobyte-2012e869-ccb0-417e-85de-814662c0871a" released by "delete_volume" :: held 0.769s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Created reservations ['3410254c-4ca5-495c-9f20-a7cfdcfa1cb9', '2742585c-e5f4-4f06-97ef-4dd21ea75dac', '907d17a9-aa7a-4587-9771-df44258b744e', '6321d73b-328e-4ecf-a97f-a1f1bb7276ea'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:13:10 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540" returned: 0 in 0.441s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:10 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540 Aug 01 15:13:10 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:10 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:13:10 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:11 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7756b121-f44e-485f-a2cd-3257ebf28540" returned: 0 in 0.299s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Lock "cinder-quobyte-7756b121-f44e-485f-a2cd-3257ebf28540" released by "delete_volume" :: held 0.833s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:11 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.320s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:13:11 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Deleted volume successfully. Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c63516c8-b9bb-4217-9fc4-c5a585ff60be tempest-VolumesActionsTest-1088664175 None] Lock "cinder-2012e869-ccb0-417e-85de-814662c0871a-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Created reservations ['13f932e4-b862-41f4-98f1-4605a3018695', 'f5153033-2358-4fad-b797-20c5048e2b00', '7ece5799-f27f-4ead-b38d-76d4832a8e31', 'fe3e1583-fdb0-4adc-b947-9ab8c00e3535'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:11 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:13:11 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:11 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.331s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:13:11 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Deleted volume successfully. Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (31978726-c1eb-4e04-b736-99bdfd7ecc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd652006-700c-4634-a673-cee4717f0e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd652006-700c-4634-a673-cee4717f0e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-482651202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e84339-a2af-4c1a-9130-6cb023789232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:12Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84636838-d313-4068-8315-d4adfdde0bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84636838-d313-4068-8315-d4adfdde0bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77a0724-f04e-4809-9816-5e7bb26bd0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77a0724-f04e-4809-9816-5e7bb26bd0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e84339-a2af-4c1a-9130-6cb023789232', 'volume_name': 'volume-64e84339-a2af-4c1a-9130-6cb023789232', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b235e2-02da-457a-bc8b-9a7e31d2b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b235e2-02da-457a-bc8b-9a7e31d2b918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe8fed4-bed9-4d61-a3e9-db972c6e6551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:11 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Volume 64e84339-a2af-4c1a-9130-6cb023789232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e84339-a2af-4c1a-9130-6cb023789232', 'volume_size': 1} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-482651202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e84339-a2af-4c1a-9130-6cb023789232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:12Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Creating volume 64e84339-a2af-4c1a-9130-6cb023789232 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:13:11 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9759886d-be5e-4624-a614-d04af63b72c7 tempest-TestStampPattern-519944343 None] Lock "cinder-7756b121-f44e-485f-a2cd-3257ebf28540-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:11 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232 1073741824 Aug 01 15:13:11 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:12 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232 1073741824" returned: 0 in 0.489s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:12 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232 Aug 01 15:13:12 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:12 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232" returned: 0 in 0.260s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:13:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe8fed4-bed9-4d61-a3e9-db972c6e6551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e84339-a2af-4c1a-9130-6cb023789232', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbea8e7-775c-46e9-b09f-822b8017edca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:12 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Volume volume-64e84339-a2af-4c1a-9130-6cb023789232 (64e84339-a2af-4c1a-9130-6cb023789232): created successfully Aug 01 15:13:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbea8e7-775c-46e9-b09f-822b8017edca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (31978726-c1eb-4e04-b736-99bdfd7ecc3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:12 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-bb59698c-1b95-4c10-9c56-0dd532fbf28b tempest-VolumesActionsTest-457079154 None] Created volume successfully. Aug 01 15:13:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Acquiring lock "cinder-64e84339-a2af-4c1a-9130-6cb023789232-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Lock "cinder-64e84339-a2af-4c1a-9130-6cb023789232-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Acquiring lock "cinder-quobyte-64e84339-a2af-4c1a-9130-6cb023789232" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Lock "cinder-quobyte-64e84339-a2af-4c1a-9130-6cb023789232" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[847fd9fe-c4e8-4355-ba7c-00b66f290b13]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:14 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232 Aug 01 15:13:14 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:14 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232" returned: 0 in 0.400s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:14 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232 Aug 01 15:13:14 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:14 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-64e84339-a2af-4c1a-9130-6cb023789232" returned: 0 in 0.335s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Lock "cinder-quobyte-64e84339-a2af-4c1a-9130-6cb023789232" released by "delete_volume" :: held 0.778s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Created reservations ['a5f6ddd4-c815-41e2-8567-408c8ea113fa', 'a7111c6e-3370-4239-b512-a58138cd822c', 'cc54bafc-b088-40e2-9e12-2fe97409f780', '656419a2-6494-4416-9584-576ef3c6995c'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:14 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:13:14 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:15 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.340s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:13:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Deleted volume successfully. Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fafbc09c-3b36-4304-b7e8-c803505ee14e tempest-VolumesActionsTest-1088664175 None] Lock "cinder-64e84339-a2af-4c1a-9130-6cb023789232-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (8988fa09-e0c0-48b4-9371-2e5e359cd8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bf8ab0-b061-4946-bdc4-38b9dd52045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bf8ab0-b061-4946-bdc4-38b9dd52045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1407801464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf2dd00-0c09-410b-82dd-b56dae9a7e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:16Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91727d67-11c4-4399-b067-3fc6b39e8d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91727d67-11c4-4399-b067-3fc6b39e8d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c55c11-73b4-4cac-b7ce-522a0367ddbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c55c11-73b4-4cac-b7ce-522a0367ddbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf2dd00-0c09-410b-82dd-b56dae9a7e96', 'volume_name': 'volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73626065-387b-491c-b1f8-640606422a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73626065-387b-491c-b1f8-640606422a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb325c7-1c8f-4716-929b-6a90d49643df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:15 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Volume 5bf2dd00-0c09-410b-82dd-b56dae9a7e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96', 'volume_size': 1} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1407801464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf2dd00-0c09-410b-82dd-b56dae9a7e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:16Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Creating volume 5bf2dd00-0c09-410b-82dd-b56dae9a7e96 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:13:15 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:13:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:15 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96 1073741824 Aug 01 15:13:15 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:16 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96 1073741824" returned: 0 in 0.454s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:16 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96 Aug 01 15:13:16 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:16 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96" returned: 0 in 0.264s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:13:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb325c7-1c8f-4716-929b-6a90d49643df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9c67dc-1d17-4b2a-95f5-0161b966c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:16 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Volume volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96 (5bf2dd00-0c09-410b-82dd-b56dae9a7e96): created successfully Aug 01 15:13:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9c67dc-1d17-4b2a-95f5-0161b966c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (8988fa09-e0c0-48b4-9371-2e5e359cd8c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:16 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e2a51909-ffb5-46f0-9fa5-4822a4fb3242 tempest-VolumesActionsTest-457079154 None] Created volume successfully. Aug 01 15:13:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Acquiring lock "cinder-5bf2dd00-0c09-410b-82dd-b56dae9a7e96-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Lock "cinder-5bf2dd00-0c09-410b-82dd-b56dae9a7e96-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Acquiring lock "cinder-quobyte-5bf2dd00-0c09-410b-82dd-b56dae9a7e96" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Lock "cinder-quobyte-5bf2dd00-0c09-410b-82dd-b56dae9a7e96" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24c7b68-5ce9-4552-8db5-7b4b543356e4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:18 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96 Aug 01 15:13:18 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:18 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96" returned: 0 in 0.374s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:18 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96 Aug 01 15:13:18 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:18 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:13:18 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:18 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bf2dd00-0c09-410b-82dd-b56dae9a7e96" returned: 0 in 0.261s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Lock "cinder-quobyte-5bf2dd00-0c09-410b-82dd-b56dae9a7e96" released by "delete_volume" :: held 0.676s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Created reservations ['ea5ea6d2-0959-4deb-95f4-1797e1dc0424', 'c9897d05-e61b-47a1-a50f-b1ff4ba946e0', '492fc107-61a8-4a6b-b5de-421cc98cdc63', '805da7ea-a268-4ae9-96f4-b1baf31396f6'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:18 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.312s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:13:18 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:13:18 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:13:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:13:19 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.274s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:13:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Deleted volume successfully. Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-383b5d73-08c1-436b-adf6-4192114c2ef2 tempest-VolumesActionsTest-1088664175 None] Lock "cinder-5bf2dd00-0c09-410b-82dd-b56dae9a7e96-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (c08a7b25-8bea-4bce-90ab-301566f3c19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c4831a-e904-404a-88fb-48d275ec26b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c4831a-e904-404a-88fb-48d275ec26b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-541587501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50d37cc-2f2b-465f-8ec4-6f401bdb1a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:20Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e51567-2c39-47b3-a4ec-ba3edb298ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e51567-2c39-47b3-a4ec-ba3edb298ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e59985-3b8b-4bb2-935e-dff0df66b469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e59985-3b8b-4bb2-935e-dff0df66b469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50d37cc-2f2b-465f-8ec4-6f401bdb1a46', 'volume_name': 'volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae8160b-8ecf-4d7e-8adc-94ec67992312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae8160b-8ecf-4d7e-8adc-94ec67992312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b564ee65-f26b-47bc-b76b-1e673b1165a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:19 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Volume f50d37cc-2f2b-465f-8ec4-6f401bdb1a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46', 'volume_size': 1} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-541587501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50d37cc-2f2b-465f-8ec4-6f401bdb1a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aabbc52267fe4a16a46c7752cac932cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:20Z,use_quota=True,user_id='f17ee0d9830143ef8bbf215f7583c90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Creating volume f50d37cc-2f2b-465f-8ec4-6f401bdb1a46 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:13:19 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:13:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:19 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46 1073741824 Aug 01 15:13:19 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:20 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46 1073741824" returned: 0 in 0.463s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:20 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46 Aug 01 15:13:20 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:20 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46" returned: 0 in 0.271s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:13:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b564ee65-f26b-47bc-b76b-1e673b1165a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77293a2-e0de-4c1d-8f52-a7aab2ea68d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:20 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Volume volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46 (f50d37cc-2f2b-465f-8ec4-6f401bdb1a46): created successfully Aug 01 15:13:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77293a2-e0de-4c1d-8f52-a7aab2ea68d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Flow 'volume_create_manager' (c08a7b25-8bea-4bce-90ab-301566f3c19f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:20 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ca1ff4f4-6811-4851-9b9e-8e7b58e4485f tempest-VolumesActionsTest-457079154 None] Created volume successfully. Aug 01 15:13:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Acquiring lock "cinder-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Lock "cinder-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Acquiring lock "cinder-quobyte-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Lock "cinder-quobyte-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:22 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7b046d-1b23-465a-a802-bf261b396d2f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:22 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46 Aug 01 15:13:22 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:22 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46" returned: 0 in 0.394s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:22 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46 Aug 01 15:13:22 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:23 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46" returned: 0 in 0.289s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Lock "cinder-quobyte-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46" released by "delete_volume" :: held 0.728s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Created reservations ['066204ea-b2aa-4804-b122-7f8b869ff336', '773591d9-2164-44fd-b869-a6737a0e0b80', '4d4d7ca9-5e18-4560-897c-0b5daec5eee2', 'ec720a69-bf41-482c-9e68-faa639e8c705'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:23 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:13:23 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:23 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.256s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:13:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Deleted volume successfully. Aug 01 15:13:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2644d32-dfc2-4167-a79e-157b419740b7 tempest-VolumesActionsTest-457079154 None] Lock "cinder-f50d37cc-2f2b-465f-8ec4-6f401bdb1a46-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:33 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=96,cinder:SELECT=64,cinder:INSERT=19,cinder:DELETE=10 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:13:33 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-cd562eb0-8f13-47f1-bdb1-a67ff154a621 req-72fbc6d1-d9e8-4dbb-9c2b-2821882cfda3 tempest-TestMinimumBasicScenario-470039605 None] Terminate volume connection completed successfully. Aug 01 15:13:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-cd562eb0-8f13-47f1-bdb1-a67ff154a621 req-72fbc6d1-d9e8-4dbb-9c2b-2821882cfda3 tempest-TestMinimumBasicScenario-470039605 None] Deleting attachment cbf8f1ca-b8a6-463c-9d71-78b1e05c2a50. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:13:33 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=82,cinder:UPDATE=90,cinder:INSERT=25,cinder:DELETE=4 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:13:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Acquiring lock "cinder-b333c388-e9f8-4726-a92e-4aa47f701609-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Lock "cinder-b333c388-e9f8-4726-a92e-4aa47f701609-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Acquiring lock "cinder-quobyte-b333c388-e9f8-4726-a92e-4aa47f701609" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Lock "cinder-quobyte-b333c388-e9f8-4726-a92e-4aa47f701609" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:34 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff396db-f211-4ca9-8b1b-5e3d3490fa22]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:34 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609 Aug 01 15:13:34 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:34 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609" returned: 0 in 0.479s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:34 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609 Aug 01 15:13:34 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:35 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b333c388-e9f8-4726-a92e-4aa47f701609" returned: 0 in 0.376s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Lock "cinder-quobyte-b333c388-e9f8-4726-a92e-4aa47f701609" released by "delete_volume" :: held 0.921s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Created reservations ['79231fb8-b854-40d1-8be4-f3939a3d35dc', '2e1e016c-369a-4f39-a918-2591b5414095', '4ae81a7a-f52e-4e89-94b2-3fd44850bc54', '629bb88c-52f4-4474-bb66-ca9ee9d687f3'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:35 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:13:35 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:35 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.430s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:13:35 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Deleted volume successfully. Aug 01 15:13:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09ad87ed-9367-471c-ae1c-2d1d1df58efb tempest-TestMinimumBasicScenario-470039605 None] Lock "cinder-b333c388-e9f8-4726-a92e-4aa47f701609-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Flow 'volume_create_manager' (ad945ef3-d064-4c63-8ddd-fc6a05642972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff272a50-be59-4a3f-b917-9320d84d83e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff272a50-be59-4a3f-b917-9320d84d83e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1024694456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c39ffb81014cf7a4fd96a27b0b7da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:40Z,use_quota=True,user_id='1870295686dc4e5db0442b152b4c7511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ab856b-444e-4acc-8751-70956461c94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ab856b-444e-4acc-8751-70956461c94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e687f74f-8eb1-48e5-ab7d-786ffc7fc738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e687f74f-8eb1-48e5-ab7d-786ffc7fc738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc', 'volume_name': 'volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ca4f1b-534c-4b34-b02d-61235827e684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ca4f1b-534c-4b34-b02d-61235827e684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb4ad62-4b23-46fe-bdc8-957714986e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:40 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Volume 85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 01 15:13:40 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Trying to clone 85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:13:41 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Image download 20.69 MB at 20.69 MB/s Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0179b7d-6bd5-49e9-8af0-ab0e96d05ce5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:41 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD Aug 01 15:13:41 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:41 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf is fetched for user 1870295686dc4e5db0442b152b4c7511. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcfae2f-411f-4026-be71-be0070990d2b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:41 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD Aug 01 15:13:41 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:41 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1024694456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c39ffb81014cf7a4fd96a27b0b7da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:40Z,use_quota=True,user_id='1870295686dc4e5db0442b152b4c7511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Creating volume 85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:13:41 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:13:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:41 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc 1073741824 Aug 01 15:13:41 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:42 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc 1073741824" returned: 0 in 0.589s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:42 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc Aug 01 15:13:42 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:42 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc" returned: 0 in 0.275s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:13:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:42 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Attempting download of a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:13:42 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3125ca1d-1f42-4229-a5d6-188ae13b7d71]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_j7gurb3a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:43 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_j7gurb3a Aug 01 15:13:43 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:43 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_j7gurb3a" returned: 0 in 0.447s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_j7gurb3a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:43 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_j7gurb3a Aug 01 15:13:43 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:43 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_j7gurb3a" returned: 1 in 0.341s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_j7gurb3a' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:13:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e7e109-ad00-4809-8a26-e1fc517645cc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:43 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD Aug 01 15:13:43 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:44 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:44 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf was qcow2, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:13:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:44 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc Aug 01 15:13:44 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:46 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc" returned: 0 in 2.197s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_ff77mjr9devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:13:46 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Converted 112.00 MB image at 50.94 MB/s Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:46 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc 1G Aug 01 15:13:46 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:46 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc 1G" returned: 0 in 0.432s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Downloaded image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf for user 1870295686dc4e5db0442b152b4c7511 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Marking volume 85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Copying metadata from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf to 85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Creating volume glance metadata for volume 85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc backed by image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb4ad62-4b23-46fe-bdc8-957714986e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0eb9fa0-2520-4be6-a662-25b265004695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Volume volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc (85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc): created successfully Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0eb9fa0-2520-4be6-a662-25b265004695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Flow 'volume_create_manager' (ad945ef3-d064-4c63-8ddd-fc6a05642972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:46 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d6a6049a-3afd-4b77-b285-54c721357784 tempest-VolumesImageMetadata-1451687710 None] Created volume successfully. Aug 01 15:13:47 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:13:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Flow 'volume_create_manager' (c497c2cc-c21d-4519-997a-5d0df466d81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b038b11-2c9e-4961-965b-f23b15f01f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b038b11-2c9e-4961-965b-f23b15f01f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-422892911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3132cadd-07f6-472c-aa33-172105ae25da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0349bd603ac4f78b8ed006909214988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:48Z,use_quota=True,user_id='aecd1671caa0449abfcd755f0b5584b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbe4080-598b-4b80-bc25-e1948c3643e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbe4080-598b-4b80-bc25-e1948c3643e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e41eec-0627-4889-a792-f76522b4b4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:47 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Acquiring lock "cinder-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Lock "cinder-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Acquiring lock "cinder-quobyte-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Lock "cinder-quobyte-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[96999514-b7cc-4883-9405-9bc60191c40c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39e41eec-0627-4889-a792-f76522b4b4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3132cadd-07f6-472c-aa33-172105ae25da', 'volume_name': 'volume-3132cadd-07f6-472c-aa33-172105ae25da', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec6d6e9-7786-400a-9a92-ee9e8ce4965b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec6d6e9-7786-400a-9a92-ee9e8ce4965b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff220767-15d5-452b-b0f9-5dd25572cf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:48 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Volume 3132cadd-07f6-472c-aa33-172105ae25da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3132cadd-07f6-472c-aa33-172105ae25da', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Trying to clone 3132cadd-07f6-472c-aa33-172105ae25da from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:13:48 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc Aug 01 15:13:48 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:48 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc" returned: 0 in 0.476s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:13:48 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Image download 20.69 MB at 20.69 MB/s Aug 01 15:13:48 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc Aug 01 15:13:48 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[389a63a1-c0d9-4153-af5a-7576f8ec75d6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:49 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD Aug 01 15:13:49 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:49 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc" returned: 0 in 0.268s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Lock "cinder-quobyte-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc" released by "delete_volume" :: held 0.791s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Created reservations ['f49bece4-58bc-4b83-a870-4568883f3b23', 'c3d3ea01-12c0-425d-a836-a4f4e56cedd2', '33782644-7152-430f-882c-e8c6bad19cfe', '3d27bc16-ce33-4711-87b1-d10d4cce9733'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:49 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:13:49 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:49 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf is fetched for user aecd1671caa0449abfcd755f0b5584b4. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c901cc1-8d65-4faa-ac30-be73016add2e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:49 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD Aug 01 15:13:49 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:49 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.330s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:13:49 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Deleted volume successfully. Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85c01d0e-de62-425a-b569-0a8746bbb989 tempest-VolumesImageMetadata-1451687710 None] Lock "cinder-85e297ff-a7b9-4dd4-9d7f-52ccf3d9e5cc-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:13:49 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-422892911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3132cadd-07f6-472c-aa33-172105ae25da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0349bd603ac4f78b8ed006909214988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:48Z,use_quota=True,user_id='aecd1671caa0449abfcd755f0b5584b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Creating volume 3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:13:49 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:13:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:49 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da 1073741824 Aug 01 15:13:49 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:50 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da 1073741824" returned: 0 in 0.551s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:50 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da Aug 01 15:13:50 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:50 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da" returned: 0 in 0.292s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:13:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:50 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Attempting download of a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 3132cadd-07f6-472c-aa33-172105ae25da. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:13:50 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ccfe89-9a55-4051-88ac-44d850e87f4d]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_wm763g_n {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:50 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_wm763g_n Aug 01 15:13:50 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:51 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_wm763g_n" returned: 0 in 0.361s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_wm763g_n {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:51 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_wm763g_n Aug 01 15:13:51 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:51 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_wm763g_n" returned: 1 in 0.375s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_wm763g_n' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:13:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83738bc-d689-47a8-a03e-0e445a600dfe]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:51 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD Aug 01 15:13:51 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:51 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:51 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf was qcow2, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:13:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:51 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da Aug 01 15:13:51 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:52 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:13:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Flow 'volume_create_manager' (2c86046d-20c7-478f-83f9-1bcde5759efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c143dae5-fb53-4ec1-b3bc-e591b36fee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c143dae5-fb53-4ec1-b3bc-e591b36fee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-66246875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8541d61-2807-40a7-83d4-ed08c60d9306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9adf1ea46054f69851d447ba6cbbd39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:53Z,use_quota=True,user_id='7149ba5b5a4e4ed89c01749e2c7b2fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c791e533-e094-4814-b502-da5d70368d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c791e533-e094-4814-b502-da5d70368d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee07a20-4b4d-49eb-a881-af4c9e58389a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee07a20-4b4d-49eb-a881-af4c9e58389a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8541d61-2807-40a7-83d4-ed08c60d9306', 'volume_name': 'volume-d8541d61-2807-40a7-83d4-ed08c60d9306', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b846c8-3af4-4fa9-81d5-b25696a77372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b846c8-3af4-4fa9-81d5-b25696a77372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78820d10-ff33-443e-b6a6-e05e9006f008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:53 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Volume d8541d61-2807-40a7-83d4-ed08c60d9306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8541d61-2807-40a7-83d4-ed08c60d9306', 'volume_size': 1} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-66246875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8541d61-2807-40a7-83d4-ed08c60d9306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9adf1ea46054f69851d447ba6cbbd39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:13:53Z,use_quota=True,user_id='7149ba5b5a4e4ed89c01749e2c7b2fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Creating volume d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:13:53 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:53 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 1073741824 Aug 01 15:13:53 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:53 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 1073741824" returned: 0 in 0.566s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:53 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 Aug 01 15:13:53 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:53 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306" returned: 0 in 0.293s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78820d10-ff33-443e-b6a6-e05e9006f008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8541d61-2807-40a7-83d4-ed08c60d9306', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c15f51-47ea-47f4-a830-bd12d581f000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:53 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da" returned: 0 in 2.105s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_66b5dkwodevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:13:53 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Converted 112.00 MB image at 53.19 MB/s Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:53 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Volume volume-d8541d61-2807-40a7-83d4-ed08c60d9306 (d8541d61-2807-40a7-83d4-ed08c60d9306): created successfully Aug 01 15:13:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c15f51-47ea-47f4-a830-bd12d581f000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Flow 'volume_create_manager' (2c86046d-20c7-478f-83f9-1bcde5759efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:54 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da 1G Aug 01 15:13:54 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-78669ceb-1d8b-4f20-a146-e754c9ef878c tempest-VolumesDeleteCascade-1602249034 None] Created volume successfully. Aug 01 15:13:54 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da 1G" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:54 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Downloaded image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 3132cadd-07f6-472c-aa33-172105ae25da successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:13:54 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf for user aecd1671caa0449abfcd755f0b5584b4 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:13:54 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Marking volume 3132cadd-07f6-472c-aa33-172105ae25da as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:13:54 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Copying metadata from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf to 3132cadd-07f6-472c-aa33-172105ae25da. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:13:54 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Creating volume glance metadata for volume 3132cadd-07f6-472c-aa33-172105ae25da backed by image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:13:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff220767-15d5-452b-b0f9-5dd25572cf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3132cadd-07f6-472c-aa33-172105ae25da', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b008719e-dede-4e5b-80cb-5d57f968f73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:13:54 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Volume volume-3132cadd-07f6-472c-aa33-172105ae25da (3132cadd-07f6-472c-aa33-172105ae25da): created successfully Aug 01 15:13:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b008719e-dede-4e5b-80cb-5d57f968f73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:13:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Flow 'volume_create_manager' (c497c2cc-c21d-4519-997a-5d0df466d81c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:13:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a86626ec-67d6-47c5-9220-8d578e8cd6a4 tempest-TestVolumeBootPattern-18811166 None] Created volume successfully. Aug 01 15:13:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] Creating offline snapshot 32c8f7ec-77fd-4ce2-85d0-ff6459b695de of volume d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:13:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3fe002-d907-4139-a033-3f8b43bac005]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:55 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 Aug 01 15:13:55 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:55 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306" returned: 0 in 0.399s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:55 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de 1G Aug 01 15:13:55 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:56 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de 1G" returned: 0 in 0.481s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8541d61-2807-40a7-83d4-ed08c60d9306 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:56 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8541d61-2807-40a7-83d4-ed08c60d9306 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de Aug 01 15:13:56 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:56 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8541d61-2807-40a7-83d4-ed08c60d9306 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de" returned: 0 in 0.347s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:56 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de is being set with open permissions: ugo+rw Aug 01 15:13:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:56 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de Aug 01 15:13:56 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:56 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de" returned: 0 in 0.276s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:56 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.info Aug 01 15:13:56 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:57 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.info" returned: 0 in 0.420s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:57 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.info is being set with open permissions: ugo+rw Aug 01 15:13:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:57 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.info Aug 01 15:13:57 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:57 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.info" returned: 0 in 0.333s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:13:57 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-bec22d88-a5c8-486a-be6e-980e6d08708d tempest-VolumesDeleteCascade-1602249034 None] Create snapshot completed successfully Aug 01 15:13:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:13:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:13:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] Creating offline snapshot f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f of volume d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:13:58 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[44576f96-518a-488f-8c37-a844133661ea]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:13:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:58 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de Aug 01 15:13:58 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:59 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de" returned: 0 in 0.493s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8541d61-2807-40a7-83d4-ed08c60d9306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:13:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:59 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f 1G Aug 01 15:13:59 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:13:59 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Aug 01 15:13:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f 1G" returned: 0 in 0.533s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:13:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:13:59 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f Aug 01 15:13:59 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:00 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:00 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f is being set with open permissions: ugo+rw Aug 01 15:14:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:00 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f Aug 01 15:14:00 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:00 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-162086c2-3bf9-47a0-a52c-d847982763a6 tempest-VolumesDeleteCascade-1602249034 None] Create snapshot completed successfully Aug 01 15:14:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-d8541d61-2807-40a7-83d4-ed08c60d9306-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-d8541d61-2807-40a7-83d4-ed08c60d9306-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Performing cascade delete. {{(pid=89024) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 01 15:14:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-32c8f7ec-77fd-4ce2-85d0-ff6459b695de-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-32c8f7ec-77fd-4ce2-85d0-ff6459b695de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-quobyte-d8541d61-2807-40a7-83d4-ed08c60d9306" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-d8541d61-2807-40a7-83d4-ed08c60d9306" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-quobyte-32c8f7ec-77fd-4ce2-85d0-ff6459b695de" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-32c8f7ec-77fd-4ce2-85d0-ff6459b695de" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Deleting offline snapshot 32c8f7ec-77fd-4ce2-85d0-ff6459b695de of volume d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] snapshot_file for this snap is: volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a0012d-ee3c-426b-a610-cc1584438ccb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:01 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de Aug 01 15:14:01 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:01 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de" returned: 0 in 0.518s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8541d61-2807-40a7-83d4-ed08c60d9306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b096364c-7e49-4f2f-ba19-a2673a7f3e7d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:01 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 Aug 01 15:14:01 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:02 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306" returned: 0 in 0.522s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:02 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b245fbc-44f3-4ccb-848b-f1d0c51026c2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:02 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f Aug 01 15:14:02 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:02 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f" returned: 0 in 0.487s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8541d61-2807-40a7-83d4-ed08c60d9306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:14:02 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[846255e2-ed34-47d9-854e-e8cbfe3e3f3f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:02 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de Aug 01 15:14:02 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-181fe71a-748e-459b-9e84-c954d8adce2b req-1abb19e1-f593-4df5-b180-811a473edbc7 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-181fe71a-748e-459b-9e84-c954d8adce2b req-1abb19e1-f593-4df5-b180-811a473edbc7 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-181fe71a-748e-459b-9e84-c954d8adce2b req-1abb19e1-f593-4df5-b180-811a473edbc7 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-181fe71a-748e-459b-9e84-c954d8adce2b req-1abb19e1-f593-4df5-b180-811a473edbc7 tempest-TestVolumeBootPattern-18811166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-3132cadd-07f6-472c-aa33-172105ae25da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11730b4d-de26-4c69-a428-fe03b0137438', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:14:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-181fe71a-748e-459b-9e84-c954d8adce2b req-1abb19e1-f593-4df5-b180-811a473edbc7 tempest-TestVolumeBootPattern-18811166 None] attachment_update completed successfully. Aug 01 15:14:03 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de" returned: 0 in 0.628s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8541d61-2807-40a7-83d4-ed08c60d9306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:14:03 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcf15b2-0428-4da1-a1f9-057700c586fb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:03 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 Aug 01 15:14:03 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:03 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306" returned: 0 in 0.509s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:04 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de Aug 01 15:14:04 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:04 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de" returned: 0 in 0.488s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:04 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de Aug 01 15:14:04 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:04 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.32c8f7ec-77fd-4ce2-85d0-ff6459b695de" returned: 0 in 0.307s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8541d61-2807-40a7-83d4-ed08c60d9306 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f -F qcow2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:04 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8541d61-2807-40a7-83d4-ed08c60d9306 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f -F qcow2 Aug 01 15:14:04 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:05 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8541d61-2807-40a7-83d4-ed08c60d9306 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f -F qcow2" returned: 0 in 0.337s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-32c8f7ec-77fd-4ce2-85d0-ff6459b695de" released by "_delete_snapshot" :: held 4.089s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-d8541d61-2807-40a7-83d4-ed08c60d9306" released by "delete_snapshot" :: held 4.138s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Created reservations ['cffe7abe-8919-4a28-b82e-6ab42596d685', '0ace281a-cdfd-4b40-a10b-10194180cba8', '02e47a47-0dad-45b3-aff0-2aba3bed26de', 'a7cabbac-8641-4a4e-893f-6faf78bf2548'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:14:05 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Delete snapshot completed successfully. Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-32c8f7ec-77fd-4ce2-85d0-ff6459b695de-delete_snapshot" released by "delete_snapshot" :: held 4.352s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-quobyte-d8541d61-2807-40a7-83d4-ed08c60d9306" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-d8541d61-2807-40a7-83d4-ed08c60d9306" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-quobyte-f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Deleting offline snapshot f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f of volume d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] snapshot_file for this snap is: volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aebe1e-aba6-45e1-8aa2-8a19229aa08d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:05 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f Aug 01 15:14:05 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:06 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f" returned: 0 in 0.590s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8541d61-2807-40a7-83d4-ed08c60d9306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:14:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33abd87-b9b4-4b7b-b3e7-8834b5b5f061]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:06 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 Aug 01 15:14:06 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:06 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306" returned: 0 in 0.682s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:06 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f Aug 01 15:14:06 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:07 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f" returned: 0 in 0.452s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:07 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f Aug 01 15:14:07 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:07 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306.f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f" returned: 0 in 0.265s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f" released by "_delete_snapshot" :: held 2.168s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-d8541d61-2807-40a7-83d4-ed08c60d9306" released by "delete_snapshot" :: held 2.204s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Created reservations ['547a9199-fec3-4387-bfca-2703ecb6d47c', '65d70f48-9b46-40eb-a26c-753439be870b', 'ccfb5c85-eadc-4088-ba37-0ce525fc4a73', '75be12e6-f472-4460-80aa-cc2530394f41'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:14:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Delete snapshot completed successfully. Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-f6198c07-4bf6-41ca-9f83-0d7a4f9dac1f-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Snapshots deleted, issuing volume delete {{(pid=89024) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-quobyte-d8541d61-2807-40a7-83d4-ed08c60d9306" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-d8541d61-2807-40a7-83d4-ed08c60d9306" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9479722d-26a4-4317-99b7-7550a6f9fdb5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:07 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 Aug 01 15:14:07 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:08 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306" returned: 0 in 0.491s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:08 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306 Aug 01 15:14:08 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:08 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d8541d61-2807-40a7-83d4-ed08c60d9306" returned: 0 in 0.273s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-d8541d61-2807-40a7-83d4-ed08c60d9306" released by "delete_volume" :: held 0.841s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:08 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Created reservations ['efb2d907-954f-49b4-9387-e9e7507cbc49', 'f08595f3-0f96-436a-b3c6-53af11aa7103', '9c713b67-a90d-43a4-a9d6-cedccc1e3931', '2c217bed-89ce-456c-b8cc-43c8b6d8a646'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:14:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:14:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:14:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:08 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:14:08 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:09 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.448s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:09 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:14:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Deleted volume successfully. Aug 01 15:14:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c2abc80-646e-4bb7-b044-01031695f86c tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-d8541d61-2807-40a7-83d4-ed08c60d9306-delete_volume" released by "delete_volume" :: held 8.399s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Flow 'volume_create_manager' (780d5e3f-79c0-4471-ad5f-cbaf313dbfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9616bdf0-342a-41c5-8b9e-6ee7ddf266e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9616bdf0-342a-41c5-8b9e-6ee7ddf266e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-951096090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c48bca-a379-4361-9242-2465ad6cf181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9adf1ea46054f69851d447ba6cbbd39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:14:11Z,use_quota=True,user_id='7149ba5b5a4e4ed89c01749e2c7b2fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70305414-59f8-4605-93e2-b7c11dc47bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70305414-59f8-4605-93e2-b7c11dc47bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b7a241-f04c-488d-9eef-8fc32db49906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b7a241-f04c-488d-9eef-8fc32db49906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c48bca-a379-4361-9242-2465ad6cf181', 'volume_name': 'volume-31c48bca-a379-4361-9242-2465ad6cf181', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8534a3f9-8b0f-41d8-97d2-db4b0f850a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8534a3f9-8b0f-41d8-97d2-db4b0f850a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7ccd0b-62ba-4522-a11e-55dc69d1c24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:10 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Volume 31c48bca-a379-4361-9242-2465ad6cf181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c48bca-a379-4361-9242-2465ad6cf181', 'volume_size': 1} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-951096090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c48bca-a379-4361-9242-2465ad6cf181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9adf1ea46054f69851d447ba6cbbd39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:14:11Z,use_quota=True,user_id='7149ba5b5a4e4ed89c01749e2c7b2fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Creating volume 31c48bca-a379-4361-9242-2465ad6cf181 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:14:10 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:14:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:10 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 1073741824 Aug 01 15:14:10 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:11 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 1073741824" returned: 0 in 0.648s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:11 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 Aug 01 15:14:11 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:12 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181" returned: 0 in 0.461s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:14:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7ccd0b-62ba-4522-a11e-55dc69d1c24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c48bca-a379-4361-9242-2465ad6cf181', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6873646e-074b-46bb-8518-8a671cdb54a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:12 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Volume volume-31c48bca-a379-4361-9242-2465ad6cf181 (31c48bca-a379-4361-9242-2465ad6cf181): created successfully Aug 01 15:14:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6873646e-074b-46bb-8518-8a671cdb54a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Flow 'volume_create_manager' (780d5e3f-79c0-4471-ad5f-cbaf313dbfa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:14:12 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b901526c-99d6-4caa-8a97-a4163eec1c3f tempest-VolumesDeleteCascade-1602249034 None] Created volume successfully. Aug 01 15:14:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] Creating offline snapshot 72ea465e-d9e8-4377-bb9d-f426cf9165d3 of volume 31c48bca-a379-4361-9242-2465ad6cf181 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:14:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb728235-eece-448c-9d9d-f3c4cb49385c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:13 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 Aug 01 15:14:13 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:13 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181" returned: 0 in 0.611s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:13 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 1G Aug 01 15:14:13 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:14 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 1G" returned: 0 in 0.687s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31c48bca-a379-4361-9242-2465ad6cf181 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:14 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31c48bca-a379-4361-9242-2465ad6cf181 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 Aug 01 15:14:14 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:15 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31c48bca-a379-4361-9242-2465ad6cf181 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3" returned: 0 in 0.561s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:15 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 is being set with open permissions: ugo+rw Aug 01 15:14:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:15 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 Aug 01 15:14:15 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:15 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3" returned: 0 in 0.360s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:15 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.info Aug 01 15:14:15 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:16 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.info" returned: 0 in 0.612s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:16 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.info is being set with open permissions: ugo+rw Aug 01 15:14:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:16 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.info Aug 01 15:14:16 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:16 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.info" returned: 0 in 0.397s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.382s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:16 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5e71e8a3-2ac6-4c31-b60f-49451862b528 tempest-VolumesDeleteCascade-1602249034 None] Create snapshot completed successfully Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Flow 'volume_create_manager' (67cf025b-687e-4d2b-9001-10e154e07268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684c2eff-fda5-4d96-8a08-2bca4c9615f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684c2eff-fda5-4d96-8a08-2bca4c9615f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1406672661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddb2313-e4bc-4c70-b12a-1236a32fd9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9adf1ea46054f69851d447ba6cbbd39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72ea465e-d9e8-4377-bb9d-f426cf9165d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:14:18Z,use_quota=True,user_id='7149ba5b5a4e4ed89c01749e2c7b2fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54faeb0-e7fb-4c7b-96ee-33dc16e21361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54faeb0-e7fb-4c7b-96ee-33dc16e21361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec32c86-4a1d-4ce1-b6f6-b4eec57081c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec32c86-4a1d-4ce1-b6f6-b4eec57081c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ddb2313-e4bc-4c70-b12a-1236a32fd9d6', 'volume_name': 'volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6', 'volume_size': 1, 'snapshot_id': '72ea465e-d9e8-4377-bb9d-f426cf9165d3'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7333b50b-f8db-4eaa-8f0d-34e8bbb1d546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7333b50b-f8db-4eaa-8f0d-34e8bbb1d546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab731cdf-a7ee-414b-8b91-df618318a70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:18 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Volume 2ddb2313-e4bc-4c70-b12a-1236a32fd9d6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6', 'volume_size': 1, 'snapshot_id': '72ea465e-d9e8-4377-bb9d-f426cf9165d3'} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-quobyte-72ea465e-d9e8-4377-bb9d-f426cf9165d3-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-72ea465e-d9e8-4377-bb9d-f426cf9165d3-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Creating volume 2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 from snapshot 72ea465e-d9e8-4377-bb9d-f426cf9165d3 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-quobyte-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] snapshot: 72ea465e-d9e8-4377-bb9d-f426cf9165d3, volume: 2ddb2313-e4bc-4c70-b12a-1236a32fd9d6, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d03506-697c-4f15-86a1-d9aa8e4bcbff]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:18 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 Aug 01 15:14:18 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:18 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:14:18 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:18 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3" returned: 0 in 0.489s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31c48bca-a379-4361-9242-2465ad6cf181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:14:18 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b728d95-3a0a-499e-936e-90b875973bd7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:19 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 Aug 01 15:14:19 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:19 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181" returned: 0 in 0.451s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:14:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:14:19 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:14:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:19 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 Aug 01 15:14:19 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:25 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" returned: 0 in 6.218s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:25 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:14:25 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Converted 1024.00 MB image at 164.65 MB/s Aug 01 15:14:25 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 is being set with open permissions: ugo+rw Aug 01 15:14:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:25 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 Aug 01 15:14:25 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:25 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" returned: 0 in 0.371s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" released by "_copy_volume_from_snapshot" :: held 7.665s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-72ea465e-d9e8-4377-bb9d-f426cf9165d3-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" released by "_create_volume_from_snapshot" :: held 7.785s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.817s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab731cdf-a7ee-414b-8b91-df618318a70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6', 'volume_size': 1, 'snapshot_id': '72ea465e-d9e8-4377-bb9d-f426cf9165d3'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640ac7d1-6a01-4901-9afa-46612a0672cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:26 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Volume volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 (2ddb2313-e4bc-4c70-b12a-1236a32fd9d6): created successfully Aug 01 15:14:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640ac7d1-6a01-4901-9afa-46612a0672cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Flow 'volume_create_manager' (67cf025b-687e-4d2b-9001-10e154e07268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:14:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b9f5008f-4755-43cd-8fbe-488a1f1467a4 tempest-VolumesDeleteCascade-1602249034 None] Created volume successfully. Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-31c48bca-a379-4361-9242-2465ad6cf181-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-31c48bca-a379-4361-9242-2465ad6cf181-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Performing cascade delete. {{(pid=89024) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-72ea465e-d9e8-4377-bb9d-f426cf9165d3-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-72ea465e-d9e8-4377-bb9d-f426cf9165d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-quobyte-31c48bca-a379-4361-9242-2465ad6cf181" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-31c48bca-a379-4361-9242-2465ad6cf181" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-quobyte-72ea465e-d9e8-4377-bb9d-f426cf9165d3" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-72ea465e-d9e8-4377-bb9d-f426cf9165d3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Deleting offline snapshot 72ea465e-d9e8-4377-bb9d-f426cf9165d3 of volume 31c48bca-a379-4361-9242-2465ad6cf181 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] snapshot_file for this snap is: volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae983f4-3b61-4d3c-bd3e-72525ab094fe]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:27 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 Aug 01 15:14:27 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:28 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3" returned: 0 in 0.471s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31c48bca-a379-4361-9242-2465ad6cf181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:14:28 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[df440ae8-4fd0-46bd-b660-b2e964e9f110]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:28 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 Aug 01 15:14:28 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:28 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181" returned: 0 in 0.760s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:28 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 Aug 01 15:14:28 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:29 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3" returned: 0 in 0.546s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:29 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3 Aug 01 15:14:29 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:29 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181.72ea465e-d9e8-4377-bb9d-f426cf9165d3" returned: 0 in 0.339s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-72ea465e-d9e8-4377-bb9d-f426cf9165d3" released by "_delete_snapshot" :: held 2.238s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-31c48bca-a379-4361-9242-2465ad6cf181" released by "delete_snapshot" :: held 2.268s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Created reservations ['c6e92f1f-537e-48f1-a656-f3dd5ecf4773', '3d3f56aa-4c6e-4496-a5a4-030661a0c42e', '97bfe0cd-3ad7-4a63-b784-316cde3f85d2', 'c7d05b7c-2f86-44f2-8b8b-19fb4bf19142'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:14:29 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Delete snapshot completed successfully. Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-72ea465e-d9e8-4377-bb9d-f426cf9165d3-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Snapshots deleted, issuing volume delete {{(pid=89024) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-quobyte-31c48bca-a379-4361-9242-2465ad6cf181" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-31c48bca-a379-4361-9242-2465ad6cf181" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[56488dda-8c1f-4f62-a473-64a1d72cfded]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:30 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 Aug 01 15:14:30 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:30 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181" returned: 0 in 0.386s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:30 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181 Aug 01 15:14:30 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:30 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31c48bca-a379-4361-9242-2465ad6cf181" returned: 0 in 0.269s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-31c48bca-a379-4361-9242-2465ad6cf181" released by "delete_volume" :: held 0.733s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:30 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Created reservations ['cf67bff1-6c54-4139-8853-d221c5994f58', 'fd7cd7d8-d823-4718-8355-0327635091fb', '064dca39-293b-4ac5-8b15-80393be35db1', '4ab6c029-8861-4f27-9e1c-558d316fea25'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:14:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:14:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:14:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:30 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:14:30 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:31 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.306s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:31 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:14:31 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Deleted volume successfully. Aug 01 15:14:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e23e7374-2784-441f-95fd-8cc53bcbd339 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-31c48bca-a379-4361-9242-2465ad6cf181-delete_volume" released by "delete_volume" :: held 3.790s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "cinder-quobyte-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:14:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:14:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[64605a89-0a65-43e1-9a64-3035dad9339e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:32 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 Aug 01 15:14:32 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:32 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" returned: 0 in 0.417s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:32 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6 Aug 01 15:14:32 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:32 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" returned: 0 in 0.371s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-quobyte-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6" released by "delete_volume" :: held 0.851s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:32 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Created reservations ['3cb548ae-a1b6-47ea-a7cf-06c96b28aee9', 'beee74a3-23e0-4812-a2f8-f288f5643353', '03f8b0ae-4a38-43dd-93d9-afcacbdd0686', '1be5ba2f-031d-47fb-bc13-0879daa0d2b8'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:14:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:14:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:14:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:33 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:14:33 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:33 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.429s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:33 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:14:33 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Deleted volume successfully. Aug 01 15:14:33 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=93,cinder:UPDATE=74,cinder:INSERT=34,cinder:DELETE=10 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:14:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e568c57-47db-4294-b005-d14d12bf7fb6 tempest-VolumesDeleteCascade-1602249034 None] Lock "cinder-2ddb2313-e4bc-4c70-b12a-1236a32fd9d6-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:14:35 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=76,cinder:INSERT=31,cinder:UPDATE=87,cinder:DELETE=3 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:14:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Creating online snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f of volume 3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:14:35 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc611683-11c2-439f-adc6-9c1740519b0e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:36 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da Aug 01 15:14:36 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:36 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da" returned: 0 in 0.472s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:36 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f 1G Aug 01 15:14:36 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:36 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f 1G" returned: 0 in 0.458s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3132cadd-07f6-472c-aa33-172105ae25da -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:36 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3132cadd-07f6-472c-aa33-172105ae25da -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f Aug 01 15:14:36 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:14:37 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Flow 'volume_create_manager' (56f5fa96-3c3e-4ede-85cb-bfcff37f28bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d783983-c578-4794-87fb-3206118fa470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3132cadd-07f6-472c-aa33-172105ae25da -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:37 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f is being set with open permissions: ugo+rw Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d783983-c578-4794-87fb-3206118fa470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1421495183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b856fa5-fdf6-481a-b232-052efe7194d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3166a0046936445f8b90d248b6f1b240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:14:37Z,use_quota=True,user_id='e066ede99c9a4c20a41066b34a99e923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:37 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f Aug 01 15:14:37 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817ac593-473b-40f0-9afe-6ad52849733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817ac593-473b-40f0-9afe-6ad52849733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca6b029-0b68-4b88-8f2b-177de012e089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca6b029-0b68-4b88-8f2b-177de012e089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b856fa5-fdf6-481a-b232-052efe7194d8', 'volume_name': 'volume-4b856fa5-fdf6-481a-b232-052efe7194d8', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3fc738-1e23-40d7-a4b5-7912f59f71c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3fc738-1e23-40d7-a4b5-7912f59f71c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a03fb0-d29f-4f2e-a518-a4dd7d33e11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:37 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Volume 4b856fa5-fdf6-481a-b232-052efe7194d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b856fa5-fdf6-481a-b232-052efe7194d8', 'volume_size': 1} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:37 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f" returned: 0 in 0.255s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:14:37 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] REQ: curl -g -i -X POST http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}764aef834c9e7be36a18637f7ca34f71e9dc614165abddb4073360bbbdb30f95" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea42faba-5d5f-4ede-9346-aa70fc81b17d" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" -d '{"snapshot": {"volume_id": "3132cadd-07f6-472c-aa33-172105ae25da", "create_info": {"type": "qcow2", "new_file": "volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f", "snapshot_id": "4ae690a0-c730-45c9-90a4-cf3e9588208f"}}}' {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:14:38 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Sat, 01 Aug 2026 13:14:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-46da2a19-ab07-4b1e-871b-b7c35fbfc99b x-openstack-request-id: req-46da2a19-ab07-4b1e-871b-b7c35fbfc99b {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:14:38 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "3132cadd-07f6-472c-aa33-172105ae25da"}} {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 01 15:14:38 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] POST call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots used request id req-46da2a19-ab07-4b1e-871b-b7c35fbfc99b {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:14:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] nova call result: None {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 01 15:14:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:53 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.info Aug 01 15:14:53 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:53 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.info" returned: 0 in 0.278s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:53 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.info is being set with open permissions: ugo+rw Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:53 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.info Aug 01 15:14:53 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:53 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.info" returned: 0 in 0.256s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 17.892s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.475s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1421495183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b856fa5-fdf6-481a-b232-052efe7194d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3166a0046936445f8b90d248b6f1b240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:14:37Z,use_quota=True,user_id='e066ede99c9a4c20a41066b34a99e923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Creating volume 4b856fa5-fdf6-481a-b232-052efe7194d8 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:14:53 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:14:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:53 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8 1073741824 Aug 01 15:14:53 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ea42faba-5d5f-4ede-9346-aa70fc81b17d tempest-TestVolumeBootPattern-18811166 None] Create snapshot completed successfully Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Flow 'volume_create_manager' (aa6d33d0-f960-451c-b631-b9c0f64bf684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c23c6d-92ab-4be9-8d8a-a9f4303aa9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c23c6d-92ab-4be9-8d8a-a9f4303aa9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-110394507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36617757-a21a-49fd-80f2-b597ba3a06a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44310dd246db4ced8b6000dc92f9f862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:14:54Z,use_quota=True,user_id='f90910638fda437382901c459e4ebb9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489ee734-6d55-4ed4-8589-41c569b8cdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489ee734-6d55-4ed4-8589-41c569b8cdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ac9cb7-8809-4b02-ac63-9c0a15f0773d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ac9cb7-8809-4b02-ac63-9c0a15f0773d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36617757-a21a-49fd-80f2-b597ba3a06a7', 'volume_name': 'volume-36617757-a21a-49fd-80f2-b597ba3a06a7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11831d43-fd54-4922-a4d6-2b4a2c8febc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11831d43-fd54-4922-a4d6-2b4a2c8febc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73bd52ff-161d-482f-9e49-b6de0faf483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:54 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Volume 36617757-a21a-49fd-80f2-b597ba3a06a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36617757-a21a-49fd-80f2-b597ba3a06a7', 'volume_size': 1} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:54 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8 1073741824" returned: 0 in 0.527s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:54 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8 Aug 01 15:14:54 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:54 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8" returned: 0 in 0.255s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.358s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-110394507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36617757-a21a-49fd-80f2-b597ba3a06a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44310dd246db4ced8b6000dc92f9f862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:14:54Z,use_quota=True,user_id='f90910638fda437382901c459e4ebb9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Creating volume 36617757-a21a-49fd-80f2-b597ba3a06a7 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:14:54 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:54 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7 1073741824 Aug 01 15:14:54 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a03fb0-d29f-4f2e-a518-a4dd7d33e11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b856fa5-fdf6-481a-b232-052efe7194d8', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e6d83b-3590-48a9-919c-304d3f8b8362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:54 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Volume volume-4b856fa5-fdf6-481a-b232-052efe7194d8 (4b856fa5-fdf6-481a-b232-052efe7194d8): created successfully Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e6d83b-3590-48a9-919c-304d3f8b8362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Flow 'volume_create_manager' (56f5fa96-3c3e-4ede-85cb-bfcff37f28bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:14:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-17af6ca0-408b-4b07-b75c-51b942c53ae9 tempest-VolumesListTestJSON-1686569208 None] Created volume successfully. Aug 01 15:14:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:55 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7 1073741824" returned: 0 in 0.421s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:55 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7 Aug 01 15:14:55 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:55 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7" returned: 0 in 0.262s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.553s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73bd52ff-161d-482f-9e49-b6de0faf483d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36617757-a21a-49fd-80f2-b597ba3a06a7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a34c1ae-fe55-4538-9ce6-2a34ff71eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Creating online snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 of volume 3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:14:55 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Volume volume-36617757-a21a-49fd-80f2-b597ba3a06a7 (36617757-a21a-49fd-80f2-b597ba3a06a7): created successfully Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a34c1ae-fe55-4538-9ce6-2a34ff71eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Flow 'volume_create_manager' (aa6d33d0-f960-451c-b631-b9c0f64bf684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2293cd-2a91-4d20-80dd-29fc4a4db867]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d1f7a1b1-b056-463a-9f9d-c790b6a25b77 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Created volume successfully. Aug 01 15:14:55 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f Aug 01 15:14:55 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Flow 'volume_create_manager' (683b88fd-e615-4422-aabb-5a20e4a6a4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ae70b4-963d-4002-a0b9-ffb15cfb9f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ae70b4-963d-4002-a0b9-ffb15cfb9f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1844599427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9622953-d7a2-49c0-bb0a-597d824520f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3166a0046936445f8b90d248b6f1b240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:14:56Z,use_quota=True,user_id='e066ede99c9a4c20a41066b34a99e923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bc1131-07c4-4ad8-9c62-54c70b960a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bc1131-07c4-4ad8-9c62-54c70b960a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55147c2-70bb-411b-a861-fe79956c330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e55147c2-70bb-411b-a861-fe79956c330b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9622953-d7a2-49c0-bb0a-597d824520f3', 'volume_name': 'volume-b9622953-d7a2-49c0-bb0a-597d824520f3', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a277945c-1fde-4544-b74a-ee2e8096293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a277945c-1fde-4544-b74a-ee2e8096293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bdef3b-361c-4cc7-934d-1a8f8c3b3f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:14:55 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Volume b9622953-d7a2-49c0-bb0a-597d824520f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9622953-d7a2-49c0-bb0a-597d824520f3', 'volume_size': 1} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:55 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f" returned: 0 in 0.378s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3132cadd-07f6-472c-aa33-172105ae25da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:14:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:55 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 1G Aug 01 15:14:55 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:56 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 1G" returned: 0 in 0.442s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:56 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 Aug 01 15:14:56 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:56 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8" returned: 0 in 0.309s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:56 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 is being set with open permissions: ugo+rw Aug 01 15:14:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:14:56 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 Aug 01 15:14:56 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:14:56 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Aug 01 15:14:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8" returned: 0 in 0.281s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:14:56 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:14:56 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] REQ: curl -g -i -X POST http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}5dfe2cebb4f6556ee9b851d0875f0001117f2c53d2ba0e078261d5801bfe2ee5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-855ba409-c0af-40cf-a454-8382ee2f92ec" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" -d '{"snapshot": {"volume_id": "3132cadd-07f6-472c-aa33-172105ae25da", "create_info": {"type": "qcow2", "new_file": "volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8", "snapshot_id": "b757df61-f60c-4bae-9bb4-97ddba370dc8"}}}' {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:14:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-52bcb186-d9ce-4d01-9835-a7924a47108a req-c83561b6-89cb-459d-be86-1f1029597fce tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:14:57 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Sat, 01 Aug 2026 13:14:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3cf7ab7f-1fab-44f4-ad4a-cabd7022afa1 x-openstack-request-id: req-3cf7ab7f-1fab-44f4-ad4a-cabd7022afa1 {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:14:57 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "3132cadd-07f6-472c-aa33-172105ae25da"}} {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 01 15:14:57 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] POST call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots used request id req-3cf7ab7f-1fab-44f4-ad4a-cabd7022afa1 {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:14:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] nova call result: None {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 01 15:14:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:14:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 18.913s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.512s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1844599427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9622953-d7a2-49c0-bb0a-597d824520f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3166a0046936445f8b90d248b6f1b240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:14:56Z,use_quota=True,user_id='e066ede99c9a4c20a41066b34a99e923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Creating volume b9622953-d7a2-49c0-bb0a-597d824520f3 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:15:14 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:14 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3 1073741824 Aug 01 15:15:14 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:14 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-855ba409-c0af-40cf-a454-8382ee2f92ec tempest-TestVolumeBootPattern-18811166 None] Create snapshot completed successfully Aug 01 15:15:14 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3 1073741824" returned: 0 in 0.409s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:14 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3 Aug 01 15:15:14 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:14 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3" returned: 0 in 0.252s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:15:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-52bcb186-d9ce-4d01-9835-a7924a47108a req-c83561b6-89cb-459d-be86-1f1029597fce tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 17.988s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bdef3b-361c-4cc7-934d-1a8f8c3b3f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9622953-d7a2-49c0-bb0a-597d824520f3', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56e499f-a6a6-4cdf-abe0-619d338f2fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-52bcb186-d9ce-4d01-9835-a7924a47108a req-c83561b6-89cb-459d-be86-1f1029597fce tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:15 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Volume volume-b9622953-d7a2-49c0-bb0a-597d824520f3 (b9622953-d7a2-49c0-bb0a-597d824520f3): created successfully Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56e499f-a6a6-4cdf-abe0-619d338f2fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Flow 'volume_create_manager' (683b88fd-e615-4422-aabb-5a20e4a6a4e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:15:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1869aec1-85ea-426d-9ee4-670c07098e89 tempest-VolumesListTestJSON-1686569208 None] Created volume successfully. Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-52bcb186-d9ce-4d01-9835-a7924a47108a req-c83561b6-89cb-459d-be86-1f1029597fce tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-36617757-a21a-49fd-80f2-b597ba3a06a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '113dddd6-c87e-484d-a8c1-b1329927ee92', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:15:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-52bcb186-d9ce-4d01-9835-a7924a47108a req-c83561b6-89cb-459d-be86-1f1029597fce tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] attachment_update completed successfully. Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Creating online snapshot b583479c-c379-4ea6-b9c6-534ae995e45e of volume 3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78498fe-f3ac-4c9b-b6be-9eb7827c69a2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:15 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 Aug 01 15:15:15 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:15 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8" returned: 0 in 0.420s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3132cadd-07f6-472c-aa33-172105ae25da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:15:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:15 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e 1G Aug 01 15:15:15 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:15:16 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Flow 'volume_create_manager' (e6aac8a9-06eb-4708-a71d-7be2f217b8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ce26ae-958f-4f00-9e86-c2faa0cce7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e 1G" returned: 0 in 0.710s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ce26ae-958f-4f00-9e86-c2faa0cce7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-126266074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ca896f-0c53-4064-980b-aeaf8befd3e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3166a0046936445f8b90d248b6f1b240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:15:16Z,use_quota=True,user_id='e066ede99c9a4c20a41066b34a99e923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:16 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e Aug 01 15:15:16 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7321c52-1aef-47c8-8e21-94600231592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7321c52-1aef-47c8-8e21-94600231592b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035c2940-d6f8-453a-a329-c0d4a98e79ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035c2940-d6f8-453a-a329-c0d4a98e79ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45ca896f-0c53-4064-980b-aeaf8befd3e5', 'volume_name': 'volume-45ca896f-0c53-4064-980b-aeaf8befd3e5', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9592653-038e-4150-8ef3-6d35429f2c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9592653-038e-4150-8ef3-6d35429f2c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520410eb-3071-42f5-8f05-51d025a9f6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:16 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Volume 45ca896f-0c53-4064-980b-aeaf8befd3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45ca896f-0c53-4064-980b-aeaf8befd3e5', 'volume_size': 1} Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:16 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e" returned: 0 in 0.334s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:16 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e is being set with open permissions: ugo+rw Aug 01 15:15:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:16 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e Aug 01 15:15:16 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:17 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e" returned: 0 in 0.252s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:17 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:15:17 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] REQ: curl -g -i -X POST http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ebb833e69de321ce0bad8fc4a5c1f8a1ef5ffb9b7bf86822172af9df2931d432" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" -d '{"snapshot": {"volume_id": "3132cadd-07f6-472c-aa33-172105ae25da", "create_info": {"type": "qcow2", "new_file": "volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e", "snapshot_id": "b583479c-c379-4ea6-b9c6-534ae995e45e"}}}' {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:15:17 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Sat, 01 Aug 2026 13:15:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f7efdc2-ca7c-469b-bae4-e7730c5225f5 x-openstack-request-id: req-1f7efdc2-ca7c-469b-bae4-e7730c5225f5 {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:15:17 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "3132cadd-07f6-472c-aa33-172105ae25da"}} {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 01 15:15:17 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] POST call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots used request id req-1f7efdc2-ca7c-469b-bae4-e7730c5225f5 {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:15:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] nova call result: None {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 01 15:15:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:17 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-3c2e3a56-395f-45da-8995-91984c4c0515 req-8226c733-fb12-4038-aa74-a4282f8e2210 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Terminate volume connection completed successfully. Aug 01 15:15:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-3c2e3a56-395f-45da-8995-91984c4c0515 req-8226c733-fb12-4038-aa74-a4282f8e2210 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Deleting attachment 113dddd6-c87e-484d-a8c1-b1329927ee92. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Acquiring lock "cinder-36617757-a21a-49fd-80f2-b597ba3a06a7-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "cinder-36617757-a21a-49fd-80f2-b597ba3a06a7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:18 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:15:18 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Acquiring lock "cinder-quobyte-36617757-a21a-49fd-80f2-b597ba3a06a7" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "cinder-quobyte-36617757-a21a-49fd-80f2-b597ba3a06a7" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b748bade-fff0-4368-aa61-849412036ff2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:18 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7 Aug 01 15:15:18 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:18 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.261s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:15:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:15:19 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7" returned: 0 in 0.365s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:19 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7 Aug 01 15:15:19 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:19 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-36617757-a21a-49fd-80f2-b597ba3a06a7" returned: 0 in 0.244s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "cinder-quobyte-36617757-a21a-49fd-80f2-b597ba3a06a7" released by "delete_volume" :: held 0.647s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Created reservations ['2791fbef-a948-4ce2-8404-300dcd7e99b5', 'a58a1a1d-6ce5-449c-bf7a-4fb857314e82', '6c55ec17-2d9f-46e4-98d0-14574f32de7a', '5876907c-e354-4c13-a1e7-28b78dbe6a91'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:19 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:15:19 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:19 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.260s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:15:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Deleted volume successfully. Aug 01 15:15:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-514a008d-2eac-48da-8302-27d8088ae2b0 tempest-TestServerVolumeAttachScenarioOldVersion-2109330143 None] Lock "cinder-36617757-a21a-49fd-80f2-b597ba3a06a7-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=50,cinder:UPDATE=27,cinder:INSERT=16,cinder:DELETE=3 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.245s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.945s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-126266074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ca896f-0c53-4064-980b-aeaf8befd3e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3166a0046936445f8b90d248b6f1b240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:15:16Z,use_quota=True,user_id='e066ede99c9a4c20a41066b34a99e923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Creating volume 45ca896f-0c53-4064-980b-aeaf8befd3e5 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:15:34 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:15:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:34 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5 1073741824 Aug 01 15:15:34 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:34 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cf5e2fbc-4078-4ed5-b96e-6d7c3cbd7c27 tempest-TestVolumeBootPattern-18811166 None] Create snapshot completed successfully Aug 01 15:15:35 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5 1073741824" returned: 0 in 0.551s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:35 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5 Aug 01 15:15:35 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:35 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:15:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520410eb-3071-42f5-8f05-51d025a9f6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ca896f-0c53-4064-980b-aeaf8befd3e5', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ee8aff-7da5-4957-bc95-9e75582fe750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:35 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Volume volume-45ca896f-0c53-4064-980b-aeaf8befd3e5 (45ca896f-0c53-4064-980b-aeaf8befd3e5): created successfully Aug 01 15:15:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ee8aff-7da5-4957-bc95-9e75582fe750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Flow 'volume_create_manager' (e6aac8a9-06eb-4708-a71d-7be2f217b8d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:15:35 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-758f7b8e-7b26-478a-b8fc-f35526903003 tempest-VolumesListTestJSON-1686569208 None] Created volume successfully. Aug 01 15:15:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-b583479c-c379-4ea6-b9c6-534ae995e45e-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-b583479c-c379-4ea6-b9c6-534ae995e45e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-b583479c-c379-4ea6-b9c6-534ae995e45e" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-b583479c-c379-4ea6-b9c6-534ae995e45e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Deleting online snapshot b583479c-c379-4ea6-b9c6-534ae995e45e of volume 3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:15:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] snapshot_file for this snap is: volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:15:36 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaafb5f3-372e-4eec-b4f4-9b260c5e0dd2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:37 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e Aug 01 15:15:37 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:37 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e" returned: 0 in 0.435s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3132cadd-07f6-472c-aa33-172105ae25da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:15:37 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c00a5ff-95d4-4d6f-b3c3-919c9b2c7f19]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:37 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 Aug 01 15:15:37 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:37 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8" returned: 0 in 0.419s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3132cadd-07f6-472c-aa33-172105ae25da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:15:37 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:15:37 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] REQ: curl -g -i -X DELETE http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots/b583479c-c379-4ea6-b9c6-534ae995e45e?delete_info={"file_to_merge": "volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f", "merge_target_file": null, "type": "qcow2", "volume_id": "3132cadd-07f6-472c-aa33-172105ae25da"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}6a60f5da731cb6434dc32d49f59e7f93c564d0379293bb82b3438cb699bfb362" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a184c76-ee38-4a22-86a9-0608dc88d1b1" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:15:38 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] RESP: [204] Connection: close Content-Type: application/json Date: Sat, 01 Aug 2026 13:15:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb6fd10e-33f7-4e7d-8d9d-e22d109cce66 x-openstack-request-id: req-eb6fd10e-33f7-4e7d-8d9d-e22d109cce66 {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:15:38 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] DELETE call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots/b583479c-c379-4ea6-b9c6-534ae995e45e?delete_info=%7B%22file_to_merge%22:%20%22volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f%22,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%223132cadd-07f6-472c-aa33-172105ae25da%22%7D used request id req-eb6fd10e-33f7-4e7d-8d9d-e22d109cce66 {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:15:38 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=22,cinder:SELECT=65,cinder:INSERT=26,cinder:DELETE=4 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:15:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] status of snapshot b583479c-c379-4ea6-b9c6-534ae995e45e is still "deleting"... waiting {{(pid=89024) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 01 15:15:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "cinder-45ca896f-0c53-4064-980b-aeaf8befd3e5-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-45ca896f-0c53-4064-980b-aeaf8befd3e5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "cinder-quobyte-45ca896f-0c53-4064-980b-aeaf8befd3e5" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-quobyte-45ca896f-0c53-4064-980b-aeaf8befd3e5" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[164a5ae7-c704-4df8-a16e-8d25de6abd1e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:39 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5 Aug 01 15:15:39 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:39 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8 Aug 01 15:15:39 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:39 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5" returned: 0 in 0.416s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:39 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5 Aug 01 15:15:39 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:39 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b757df61-f60c-4bae-9bb4-97ddba370dc8" returned: 0 in 0.295s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-b583479c-c379-4ea6-b9c6-534ae995e45e" released by "_delete_snapshot" :: held 2.650s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" released by "delete_snapshot" :: held 2.678s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Created reservations ['441e56b7-39b3-4541-bb0e-6c9711425899', '609c2e7e-044b-4c1f-be85-71cd59d8a4c4', '532b52e9-d59a-491e-adf5-2505d32329c4', '6b256da0-a058-4311-a76e-9b2736c61eed'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:15:39 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Delete snapshot completed successfully. Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a184c76-ee38-4a22-86a9-0608dc88d1b1 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-b583479c-c379-4ea6-b9c6-534ae995e45e-delete_snapshot" released by "delete_snapshot" :: held 2.861s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:39 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-45ca896f-0c53-4064-980b-aeaf8befd3e5" returned: 0 in 0.264s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-quobyte-45ca896f-0c53-4064-980b-aeaf8befd3e5" released by "delete_volume" :: held 0.722s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Created reservations ['55d7156c-2ce2-44d2-821b-8c9661473b8e', 'c2fbcdf3-8ded-4472-9a30-7a12f7e67cd1', '43245529-8026-4a3c-8e23-98e3c0001e8b', '1be49695-74f8-400b-9122-d6e77085ee76'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:39 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:15:39 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-b757df61-f60c-4bae-9bb4-97ddba370dc8-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-b757df61-f60c-4bae-9bb4-97ddba370dc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-b757df61-f60c-4bae-9bb4-97ddba370dc8" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-b757df61-f60c-4bae-9bb4-97ddba370dc8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Deleting online snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 of volume 3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:15:40 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] snapshot_file for this snap is: volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.286s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:15:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Deleted volume successfully. Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecf4308-4c99-4ede-8166-3fbcfe76c576]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "cinder-b9622953-d7a2-49c0-bb0a-597d824520f3-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c20094b6-d6f3-4719-bf94-63ae6f81c8a8 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-45ca896f-0c53-4064-980b-aeaf8befd3e5-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-b9622953-d7a2-49c0-bb0a-597d824520f3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "cinder-quobyte-b9622953-d7a2-49c0-bb0a-597d824520f3" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-quobyte-b9622953-d7a2-49c0-bb0a-597d824520f3" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[da376e9c-22ff-4ff4-84f5-79574d8108a8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:40 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e Aug 01 15:15:40 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:40 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3 Aug 01 15:15:40 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:40 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e" returned: 0 in 0.467s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3132cadd-07f6-472c-aa33-172105ae25da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bd7814-7806-4df2-9485-b3b48c211052]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:40 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3" returned: 0 in 0.445s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:40 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f Aug 01 15:15:40 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:40 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3 Aug 01 15:15:40 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:41 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b9622953-d7a2-49c0-bb0a-597d824520f3" returned: 0 in 0.271s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-quobyte-b9622953-d7a2-49c0-bb0a-597d824520f3" released by "delete_volume" :: held 0.756s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:41 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f" returned: 0 in 0.405s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3132cadd-07f6-472c-aa33-172105ae25da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Created reservations ['d83747af-5a79-4876-ac81-31054e2f9859', '51a1ec86-eb16-446d-9604-399ec2078c72', 'b42f1699-ac7f-44d2-a4da-40f363d64a12', '4ce8867a-7bda-444d-affe-b00b2b49c843'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] REQ: curl -g -i -X DELETE http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots/b757df61-f60c-4bae-9bb4-97ddba370dc8?delete_info={"file_to_merge": "volume-3132cadd-07f6-472c-aa33-172105ae25da", "merge_target_file": null, "type": "qcow2", "volume_id": "3132cadd-07f6-472c-aa33-172105ae25da"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c6f85d096d397a0fe87f2012ea0375b30d0acf030da9b7b5279a030da7455859" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c07d30e-95ee-4440-b10d-f4582e02dd68" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:41 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:15:41 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] RESP: [204] Connection: close Content-Type: application/json Date: Sat, 01 Aug 2026 13:15:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6eaffe4d-5092-4e1f-8b68-38d2db53b7ca x-openstack-request-id: req-6eaffe4d-5092-4e1f-8b68-38d2db53b7ca {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] DELETE call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots/b757df61-f60c-4bae-9bb4-97ddba370dc8?delete_info=%7B%22file_to_merge%22:%20%22volume-3132cadd-07f6-472c-aa33-172105ae25da%22,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%223132cadd-07f6-472c-aa33-172105ae25da%22%7D used request id req-6eaffe4d-5092-4e1f-8b68-38d2db53b7ca {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] status of snapshot b757df61-f60c-4bae-9bb4-97ddba370dc8 is still "deleting"... waiting {{(pid=89024) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "cinder-4b856fa5-fdf6-481a-b232-052efe7194d8-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-4b856fa5-fdf6-481a-b232-052efe7194d8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "cinder-quobyte-4b856fa5-fdf6-481a-b232-052efe7194d8" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:41 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.365s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-quobyte-4b856fa5-fdf6-481a-b232-052efe7194d8" acquired by "delete_volume" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:41 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Deleted volume successfully. Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7829cd0-a13c-466a-b3ae-08c777979089]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-464dbbf1-d417-469f-a438-bafd19b25e90 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-b9622953-d7a2-49c0-bb0a-597d824520f3-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:41 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8 Aug 01 15:15:41 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:42 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8" returned: 0 in 0.457s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:42 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8 Aug 01 15:15:42 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:42 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b856fa5-fdf6-481a-b232-052efe7194d8" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:42 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f Aug 01 15:15:42 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-quobyte-4b856fa5-fdf6-481a-b232-052efe7194d8" released by "delete_volume" :: held 0.816s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Created reservations ['e406cce8-491c-4653-8f88-4190cac3f379', 'c62de2c7-d09c-4922-a960-99c2d6500725', '173ab97f-5a3b-4a22-a193-c1153ef2af5f', '76480649-ff99-468a-9246-4acfb0277649'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:42 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:15:42 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:42 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.4ae690a0-c730-45c9-90a4-cf3e9588208f" returned: 0 in 0.375s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-b757df61-f60c-4bae-9bb4-97ddba370dc8" released by "_delete_snapshot" :: held 2.695s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" released by "delete_snapshot" :: held 2.735s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Created reservations ['4d11b271-b976-46d5-bf09-f012672486b9', '056f299a-e829-4de6-961f-49f40c386725', '2a176ff1-2b09-46e2-b0a3-064c87706824', 'b02e8c54-286f-4ead-8916-fdc9f2ee24c2'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:15:42 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.303s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:42 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:15:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Deleted volume successfully. Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9c9e06e-fc3d-43e0-ae31-6a65c419bb88 tempest-VolumesListTestJSON-1686569208 None] Lock "cinder-4b856fa5-fdf6-481a-b232-052efe7194d8-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Delete snapshot completed successfully. Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c07d30e-95ee-4440-b10d-f4582e02dd68 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-b757df61-f60c-4bae-9bb4-97ddba370dc8-delete_snapshot" released by "delete_snapshot" :: held 2.982s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-4ae690a0-c730-45c9-90a4-cf3e9588208f-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-4ae690a0-c730-45c9-90a4-cf3e9588208f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-4ae690a0-c730-45c9-90a4-cf3e9588208f" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-4ae690a0-c730-45c9-90a4-cf3e9588208f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Deleting online snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f of volume 3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] snapshot_file for this snap is: volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[46968b24-d94b-450c-ab7f-1949734267ad]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:43 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e Aug 01 15:15:43 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:43 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e" returned: 0 in 0.409s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3132cadd-07f6-472c-aa33-172105ae25da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea20eaf3-7b2c-46ab-8fa7-08302077bdd6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:44 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da Aug 01 15:15:44 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:44 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da" returned: 0 in 0.457s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:44 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:15:44 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] REQ: curl -g -i -X DELETE http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots/4ae690a0-c730-45c9-90a4-cf3e9588208f?delete_info={"file_to_merge": null, "merge_target_file": null, "type": "qcow2", "volume_id": "3132cadd-07f6-472c-aa33-172105ae25da"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94a99e2d8a601bcd1198568a590814570cdc0617fab7c5f6cf7d3295637f9546" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e46d49b8-3990-4b51-8c70-b59b6263ae62" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:15:44 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] RESP: [204] Connection: close Content-Type: application/json Date: Sat, 01 Aug 2026 13:15:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19025fe9-8a16-46aa-96fe-17a76d59416a x-openstack-request-id: req-19025fe9-8a16-46aa-96fe-17a76d59416a {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:15:44 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] DELETE call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots/4ae690a0-c730-45c9-90a4-cf3e9588208f?delete_info=%7B%22file_to_merge%22:%20null,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%223132cadd-07f6-472c-aa33-172105ae25da%22%7D used request id req-19025fe9-8a16-46aa-96fe-17a76d59416a {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:15:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is still "deleting"... waiting {{(pid=89024) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 01 15:15:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is still "deleting"... waiting {{(pid=89024) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Flow 'volume_create_manager' (8f78a998-0a4d-4c11-86ec-926933cedf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef8c86e-b890-4204-83be-fa16213c8c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] status of snapshot 4ae690a0-c730-45c9-90a4-cf3e9588208f is still "deleting"... waiting {{(pid=89024) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef8c86e-b890-4204-83be-fa16213c8c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1259281051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bd796a-4689-4952-969a-c355461f6e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee59cf1a095f4c4a9f8d13f114cc9c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:15:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:15:47Z,use_quota=True,user_id='dfe7943aa1cf4c88be8f20b851d66f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9049f42-e902-46cf-b1a5-1bcb87d6dffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9049f42-e902-46cf-b1a5-1bcb87d6dffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed072534-9ae7-4c90-a845-9fcbe494e044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed072534-9ae7-4c90-a845-9fcbe494e044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bd796a-4689-4952-969a-c355461f6e4c', 'volume_name': 'volume-d2bd796a-4689-4952-969a-c355461f6e4c', 'volume_size': 2}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7541efcc-ec2c-4eee-8ad0-36403c4270f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7541efcc-ec2c-4eee-8ad0-36403c4270f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a458521e-0463-4d8f-8314-f30cb1327c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Volume d2bd796a-4689-4952-969a-c355461f6e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bd796a-4689-4952-969a-c355461f6e4c', 'volume_size': 2} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1259281051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bd796a-4689-4952-969a-c355461f6e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee59cf1a095f4c4a9f8d13f114cc9c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:15:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:15:47Z,use_quota=True,user_id='dfe7943aa1cf4c88be8f20b851d66f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Creating volume d2bd796a-4689-4952-969a-c355461f6e4c {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:15:46 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:15:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c 2147483648 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:46 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c 2147483648 Aug 01 15:15:46 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:47 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c 2147483648" returned: 0 in 0.610s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:47 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c Aug 01 15:15:47 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:47 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c" returned: 0 in 0.273s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:15:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a458521e-0463-4d8f-8314-f30cb1327c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bd796a-4689-4952-969a-c355461f6e4c', 'volume_size': 2}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe41a90-1124-4f53-82d7-3892ba73e81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Volume volume-d2bd796a-4689-4952-969a-c355461f6e4c (d2bd796a-4689-4952-969a-c355461f6e4c): created successfully Aug 01 15:15:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe41a90-1124-4f53-82d7-3892ba73e81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Flow 'volume_create_manager' (8f78a998-0a4d-4c11-86ec-926933cedf08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:15:47 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da Aug 01 15:15:47 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-198ea34d-9e89-4146-bdeb-0c58f96c8fc9 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Created volume successfully. Aug 01 15:15:48 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da" returned: 0 in 0.301s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-4ae690a0-c730-45c9-90a4-cf3e9588208f" released by "_delete_snapshot" :: held 4.832s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" released by "delete_snapshot" :: held 4.869s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:48 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Created reservations ['742783aa-369f-4352-b594-d8dce1b77b4e', '2c7e9508-8c78-4a1a-adda-774ff4c0c917', '160c50c8-85c7-47cb-b514-43c75fe2f232', '73a1619d-df03-4efb-a526-33c872b0d879'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:15:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Delete snapshot completed successfully. Aug 01 15:15:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e46d49b8-3990-4b51-8c70-b59b6263ae62 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-4ae690a0-c730-45c9-90a4-cf3e9588208f-delete_snapshot" released by "delete_snapshot" :: held 5.086s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Creating offline snapshot e2df2c29-e29b-4da3-9cdb-e7accd45174f of volume d2bd796a-4689-4952-969a-c355461f6e4c {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:15:49 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbb3dbb-e59f-41ac-a3f7-3fb0813d8086]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:49 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c Aug 01 15:15:49 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:49 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c" returned: 0 in 0.488s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f 2G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:49 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f 2G Aug 01 15:15:49 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:50 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f 2G" returned: 0 in 0.585s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2bd796a-4689-4952-969a-c355461f6e4c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:50 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2bd796a-4689-4952-969a-c355461f6e4c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f Aug 01 15:15:50 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-83d888ca-e4c4-45e7-b539-b8a10db34c05 req-78d160e4-6fb4-4c1d-af89-4eb7cbc6dac4 tempest-TestVolumeBootPattern-18811166 None] Terminate volume connection completed successfully. Aug 01 15:15:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-83d888ca-e4c4-45e7-b539-b8a10db34c05 req-78d160e4-6fb4-4c1d-af89-4eb7cbc6dac4 tempest-TestVolumeBootPattern-18811166 None] Deleting attachment 11730b4d-de26-4c69-a428-fe03b0137438. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:15:50 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2bd796a-4689-4952-969a-c355461f6e4c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f" returned: 0 in 0.375s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:50 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f is being set with open permissions: ugo+rw Aug 01 15:15:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:50 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f Aug 01 15:15:50 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:51 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f" returned: 0 in 0.279s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:51 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.info Aug 01 15:15:51 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:51 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.info" returned: 0 in 0.301s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:51 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.info is being set with open permissions: ugo+rw Aug 01 15:15:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:51 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.info Aug 01 15:15:51 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:51 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.info" returned: 0 in 0.296s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.468s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1fc9aa0a-f237-448a-9e23-0cdfb2508ce1 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Create snapshot completed successfully Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Acquiring lock "cinder-e2df2c29-e29b-4da3-9cdb-e7accd45174f-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "cinder-e2df2c29-e29b-4da3-9cdb-e7accd45174f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Acquiring lock "cinder-quobyte-d2bd796a-4689-4952-969a-c355461f6e4c" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "cinder-quobyte-d2bd796a-4689-4952-969a-c355461f6e4c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Acquiring lock "cinder-quobyte-e2df2c29-e29b-4da3-9cdb-e7accd45174f" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "cinder-quobyte-e2df2c29-e29b-4da3-9cdb-e7accd45174f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Deleting offline snapshot e2df2c29-e29b-4da3-9cdb-e7accd45174f of volume d2bd796a-4689-4952-969a-c355461f6e4c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] snapshot_file for this snap is: volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7d6651-ee7f-49a1-858c-1612b934668f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-3132cadd-07f6-472c-aa33-172105ae25da-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-3132cadd-07f6-472c-aa33-172105ae25da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:52 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f Aug 01 15:15:52 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:53 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e Aug 01 15:15:53 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:53 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f" returned: 0 in 0.462s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2bd796a-4689-4952-969a-c355461f6e4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:15:53 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3132cadd-07f6-472c-aa33-172105ae25da.b583479c-c379-4ea6-b9c6-534ae995e45e" returned: 0 in 0.300s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[81984f10-93ef-42c7-8068-6ec11eec9a0b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-3132cadd-07f6-472c-aa33-172105ae25da" released by "delete_volume" :: held 0.385s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Created reservations ['95af6348-a792-46e6-bb02-ba0488f838f6', '8f439ae6-a39a-462b-bb17-b8caabbabd73', 'dd535710-fa05-48ec-80cd-29aa19c5322e', 'a78708c2-c3d0-4097-9f75-290c30637dfa'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:15:53 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c Aug 01 15:15:53 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:53 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:15:53 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:53 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c" returned: 0 in 0.407s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:53 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f Aug 01 15:15:53 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:53 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.290s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:15:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Deleted volume successfully. Aug 01 15:15:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d425222b-7ec8-4ee9-8b87-0473bad50c7a tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-3132cadd-07f6-472c-aa33-172105ae25da-delete_volume" released by "delete_volume" :: held 0.960s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:54 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f" returned: 0 in 0.465s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:54 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f Aug 01 15:15:54 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:54 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c.e2df2c29-e29b-4da3-9cdb-e7accd45174f" returned: 0 in 0.280s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "cinder-quobyte-e2df2c29-e29b-4da3-9cdb-e7accd45174f" released by "_delete_snapshot" :: held 1.772s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "cinder-quobyte-d2bd796a-4689-4952-969a-c355461f6e4c" released by "delete_snapshot" :: held 1.799s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Created reservations ['67e96743-0a77-44ef-a021-bd763e8d7efe', 'a8d4da47-3b63-426c-8714-75cec7d28531', '1923b612-9b34-4556-8975-06c9fee3f3ed', '602b1f23-bc89-4e69-b907-51fbc7b9cd77'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:15:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Delete snapshot completed successfully. Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a920c47c-8cdc-41a9-bc31-385c6dce660e tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "cinder-e2df2c29-e29b-4da3-9cdb-e7accd45174f-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Flow 'volume_create_manager' (a66e0183-b4f1-4420-8269-81a1a5e3bb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fa089a-af3b-41ee-9c31-96f882ff6f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fa089a-af3b-41ee-9c31-96f882ff6f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-207229172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820da1fe-9a4f-4ba3-a63f-bcc352d365cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0349bd603ac4f78b8ed006909214988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:15:55Z,use_quota=True,user_id='aecd1671caa0449abfcd755f0b5584b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600c8589-069d-4822-8147-92444c770137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600c8589-069d-4822-8147-92444c770137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13edfd4-d87a-4fb6-a395-7f08eb76652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:54 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Acquiring lock "cinder-d2bd796a-4689-4952-969a-c355461f6e4c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "cinder-d2bd796a-4689-4952-969a-c355461f6e4c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Acquiring lock "cinder-quobyte-d2bd796a-4689-4952-969a-c355461f6e4c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "cinder-quobyte-d2bd796a-4689-4952-969a-c355461f6e4c" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3738633b-05e7-4003-ad66-adc6cf65c0e5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:55 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c Aug 01 15:15:55 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13edfd4-d87a-4fb6-a395-7f08eb76652c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '820da1fe-9a4f-4ba3-a63f-bcc352d365cc', 'volume_name': 'volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aabe2ea-a92d-4aa4-9054-a943a4ef5863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aabe2ea-a92d-4aa4-9054-a943a4ef5863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9f3229-faf6-4b09-95e4-c1945ff0ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:55 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Volume 820da1fe-9a4f-4ba3-a63f-bcc352d365cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Trying to clone 820da1fe-9a4f-4ba3-a63f-bcc352d365cc from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:15:55 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c" returned: 0 in 0.481s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:55 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c Aug 01 15:15:55 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:15:55 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Image download 20.69 MB at 20.69 MB/s Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[297764a6-e07a-4870-8391-96be22a601fe]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:56 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d2bd796a-4689-4952-969a-c355461f6e4c" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "cinder-quobyte-d2bd796a-4689-4952-969a-c355461f6e4c" released by "delete_volume" :: held 0.908s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Created reservations ['ad0be9da-8505-418a-a310-8eb92d971603', 'fb63be76-7d56-48d2-a2e8-580579df8717', 'db27c595-3579-49ea-8304-35267b391d4f', '94613e5a-0bd0-4d45-af17-88c647c27b31'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:15:56 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD Aug 01 15:15:56 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:56 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:15:56 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:56 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD" returned: 0 in 0.480s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf is fetched for user aecd1671caa0449abfcd755f0b5584b4. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:15:56 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.326s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:15:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Deleted volume successfully. Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f78f3cf7-362b-4dfb-8cc6-ea352ee31819 tempest-VolumesSnapshotNegativeTestJSON-1250544530 None] Lock "cinder-d2bd796a-4689-4952-969a-c355461f6e4c-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[60461944-1544-4887-8cd6-fa8e4e45c863]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:56 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD Aug 01 15:15:56 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:56 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-207229172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820da1fe-9a4f-4ba3-a63f-bcc352d365cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0349bd603ac4f78b8ed006909214988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:15:55Z,use_quota=True,user_id='aecd1671caa0449abfcd755f0b5584b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Creating volume 820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:15:56 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:15:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:57 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc 1073741824 Aug 01 15:15:57 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:57 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc 1073741824" returned: 0 in 0.540s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:57 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc Aug 01 15:15:57 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:57 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" returned: 0 in 0.286s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:15:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:57 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Attempting download of a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 820da1fe-9a4f-4ba3-a63f-bcc352d365cc. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:15:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb756a5a-0d1c-4845-99fb-1be41f628efe]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_605t0kse {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:58 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_605t0kse Aug 01 15:15:58 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:58 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_605t0kse" returned: 0 in 0.370s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_605t0kse {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:58 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_605t0kse Aug 01 15:15:58 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:58 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_605t0kse" returned: 1 in 0.470s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_605t0kse' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:15:58 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a86cf94-3e4e-4eb4-bcc6-4cc9f5f45845]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:15:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:58 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD Aug 01 15:15:58 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:59 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD" returned: 0 in 0.424s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf was qcow2, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:59 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc Aug 01 15:15:59 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (a95d3573-1ca6-425a-8679-0ad975781387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5007d4-d834-4fae-8fa1-e577a3cdd75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5007d4-d834-4fae-8fa1-e577a3cdd75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2138203086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31566f74-03ff-4d23-8927-a3253b58904d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:00Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4801665-de97-4885-8c59-cd5d6fa992de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4801665-de97-4885-8c59-cd5d6fa992de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc71ade-1242-4f58-9bf5-58560aed41b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc71ade-1242-4f58-9bf5-58560aed41b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31566f74-03ff-4d23-8927-a3253b58904d', 'volume_name': 'volume-31566f74-03ff-4d23-8927-a3253b58904d', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47aa4f8-83af-4454-85a5-bfdfe2a01c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47aa4f8-83af-4454-85a5-bfdfe2a01c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce9c08f-94f1-4d81-b5ca-ed5bd439e18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:15:59 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume 31566f74-03ff-4d23-8927-a3253b58904d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31566f74-03ff-4d23-8927-a3253b58904d', 'volume_size': 1} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2138203086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31566f74-03ff-4d23-8927-a3253b58904d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:00Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Creating volume 31566f74-03ff-4d23-8927-a3253b58904d {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:15:59 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:15:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:15:59 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d 1073741824 Aug 01 15:15:59 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:00 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d 1073741824" returned: 0 in 0.613s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:00 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d Aug 01 15:16:00 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:00 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d" returned: 0 in 0.300s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce9c08f-94f1-4d81-b5ca-ed5bd439e18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31566f74-03ff-4d23-8927-a3253b58904d', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04b9acf-ccb5-4170-8f54-ba7d45934768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:00 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume volume-31566f74-03ff-4d23-8927-a3253b58904d (31566f74-03ff-4d23-8927-a3253b58904d): created successfully Aug 01 15:16:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04b9acf-ccb5-4170-8f54-ba7d45934768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (a95d3573-1ca6-425a-8679-0ad975781387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b6869550-ce56-438d-b0cc-8dc5a9e6bac1 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created volume successfully. Aug 01 15:16:01 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" returned: 0 in 2.188s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_lgyee1y7devstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:16:01 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Converted 112.00 MB image at 51.15 MB/s Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:01 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc 1G Aug 01 15:16:01 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:01 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc 1G" returned: 0 in 0.376s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Downloaded image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 820da1fe-9a4f-4ba3-a63f-bcc352d365cc successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf for user aecd1671caa0449abfcd755f0b5584b4 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Marking volume 820da1fe-9a4f-4ba3-a63f-bcc352d365cc as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Copying metadata from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf to 820da1fe-9a4f-4ba3-a63f-bcc352d365cc. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Creating volume glance metadata for volume 820da1fe-9a4f-4ba3-a63f-bcc352d365cc backed by image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9f3229-faf6-4b09-95e4-c1945ff0ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081ef31a-a18a-4a96-bc42-cffa740d9cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:01 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Volume volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc (820da1fe-9a4f-4ba3-a63f-bcc352d365cc): created successfully Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081ef31a-a18a-4a96-bc42-cffa740d9cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Flow 'volume_create_manager' (a66e0183-b4f1-4420-8269-81a1a5e3bb09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:01 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6bea3d64-24b4-49f2-8c83-7c1d39bb169d tempest-TestVolumeBootPattern-18811166 None] Created volume successfully. Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (1cf8bc13-5407-42b1-85a1-1c8f6ba16c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919a435c-afa5-4038-b5a6-52274defeb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919a435c-afa5-4038-b5a6-52274defeb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312814119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e30856e-bbc7-4991-a029-61a72dec5637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:02Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba3ff31-92b0-440e-b7a5-1bc64950aef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba3ff31-92b0-440e-b7a5-1bc64950aef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743cf63d-31f7-4679-8192-13e72af9020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743cf63d-31f7-4679-8192-13e72af9020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e30856e-bbc7-4991-a029-61a72dec5637', 'volume_name': 'volume-1e30856e-bbc7-4991-a029-61a72dec5637', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171a0387-f8aa-41f0-be60-bde0b4a7edeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171a0387-f8aa-41f0-be60-bde0b4a7edeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d35ed2-9710-4bc8-ad47-315ad4dcd854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:02 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume 1e30856e-bbc7-4991-a029-61a72dec5637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e30856e-bbc7-4991-a029-61a72dec5637', 'volume_size': 1} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-312814119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e30856e-bbc7-4991-a029-61a72dec5637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:02Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Creating volume 1e30856e-bbc7-4991-a029-61a72dec5637 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:02 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:02 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637 1073741824 Aug 01 15:16:02 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (a4e0be15-0cb4-4ac8-996e-317766d1e94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e7ef91-37a2-4b3f-b99e-4e76a1e9a8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e7ef91-37a2-4b3f-b99e-4e76a1e9a8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-120593451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85c7843-eff6-441b-8a0f-332a774ff4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:03Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b7b843-1e8c-44ae-b5c7-9c4db52bb121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b7b843-1e8c-44ae-b5c7-9c4db52bb121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c066d68-5780-4321-a56c-595aa07f80b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c066d68-5780-4321-a56c-595aa07f80b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e85c7843-eff6-441b-8a0f-332a774ff4ec', 'volume_name': 'volume-e85c7843-eff6-441b-8a0f-332a774ff4ec', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95aae853-49a1-41da-9fc1-acecf8d9f4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95aae853-49a1-41da-9fc1-acecf8d9f4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de22290d-6e1b-4693-81e1-0e4f130a4bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume e85c7843-eff6-441b-8a0f-332a774ff4ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e85c7843-eff6-441b-8a0f-332a774ff4ec', 'volume_size': 1} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:03 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637 1073741824" returned: 0 in 0.768s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:03 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637 Aug 01 15:16:03 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (ad76c989-bf22-4a81-949a-0f54fc7cbcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cdcc30-7dac-4d06-a3b5-58e8bdcd2ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cdcc30-7dac-4d06-a3b5-58e8bdcd2ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607728853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3123306-fcaa-4cd9-9646-d49b25084dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:03Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5744a0f3-db1c-4158-b76d-e18a73173f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5744a0f3-db1c-4158-b76d-e18a73173f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff6bf2b-edd7-4572-958e-98e460e07596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff6bf2b-edd7-4572-958e-98e460e07596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3123306-fcaa-4cd9-9646-d49b25084dde', 'volume_name': 'volume-a3123306-fcaa-4cd9-9646-d49b25084dde', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47b64d0-ff8c-48a6-9adb-2fbcb9856c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47b64d0-ff8c-48a6-9adb-2fbcb9856c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45259158-b897-45e5-9b23-99ba175f9214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume a3123306-fcaa-4cd9-9646-d49b25084dde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3123306-fcaa-4cd9-9646-d49b25084dde', 'volume_size': 1} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:03 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637" returned: 0 in 0.365s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.558s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-120593451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85c7843-eff6-441b-8a0f-332a774ff4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:03Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Creating volume e85c7843-eff6-441b-8a0f-332a774ff4ec {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:03 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d35ed2-9710-4bc8-ad47-315ad4dcd854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e30856e-bbc7-4991-a029-61a72dec5637', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec 1073741824 Aug 01 15:16:03 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f450ec9d-0f0f-4f3c-a7ee-fe50b3caf770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume volume-1e30856e-bbc7-4991-a029-61a72dec5637 (1e30856e-bbc7-4991-a029-61a72dec5637): created successfully Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f450ec9d-0f0f-4f3c-a7ee-fe50b3caf770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (1cf8bc13-5407-42b1-85a1-1c8f6ba16c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-137e1253-3eed-4e64-92b7-5bf8f7f09029 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created volume successfully. Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (4a1017ee-f92c-43e4-96c1-cc0a505daa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11e249a-51a0-46eb-a36f-f534c92284bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11e249a-51a0-46eb-a36f-f534c92284bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527900109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50dd7e26-93a1-4906-a9f0-37d77f066f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:04Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcb664c-8aa1-4a4a-a10f-f2956cf40a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcb664c-8aa1-4a4a-a10f-f2956cf40a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b3888a-b288-41fb-a489-0a433e926225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b3888a-b288-41fb-a489-0a433e926225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50dd7e26-93a1-4906-a9f0-37d77f066f03', 'volume_name': 'volume-50dd7e26-93a1-4906-a9f0-37d77f066f03', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865b7f05-b10e-4b63-a626-d2d07e770fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865b7f05-b10e-4b63-a626-d2d07e770fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf44bc7-cfcc-48fa-b92f-313b4172271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume 50dd7e26-93a1-4906-a9f0-37d77f066f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50dd7e26-93a1-4906-a9f0-37d77f066f03', 'volume_size': 1} Aug 01 15:16:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (6cf4fa3f-af23-4152-a5dc-25cb27e52534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee78729-d750-4f44-8b23-4e4628b1d806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee78729-d750-4f44-8b23-4e4628b1d806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817001579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d94386-9d6a-405c-a336-f307625cef9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:04Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b8fad7-9fcd-4e5f-ac95-e2cf169a60a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b8fad7-9fcd-4e5f-ac95-e2cf169a60a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbd2e20-4374-4738-ba7b-c909547a6fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:04 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbd2e20-4374-4738-ba7b-c909547a6fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d94386-9d6a-405c-a336-f307625cef9e', 'volume_name': 'volume-e5d94386-9d6a-405c-a336-f307625cef9e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76685728-fc3e-4a12-8f0e-764e67441779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76685728-fc3e-4a12-8f0e-764e67441779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d1f3c3-445f-49fd-a488-d5ea223c65fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:04 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume e5d94386-9d6a-405c-a336-f307625cef9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d94386-9d6a-405c-a336-f307625cef9e', 'volume_size': 1} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec 1073741824" returned: 0 in 0.671s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:04 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec Aug 01 15:16:04 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:04 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec" returned: 0 in 0.264s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.536s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de22290d-6e1b-4693-81e1-0e4f130a4bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e85c7843-eff6-441b-8a0f-332a774ff4ec', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5ce9cb-0a90-4b4d-9275-0f4c0e9c98a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] Creating offline snapshot a471d30e-b205-4114-895c-c9ad43e00ad7 of volume 820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:16:04 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume volume-e85c7843-eff6-441b-8a0f-332a774ff4ec (e85c7843-eff6-441b-8a0f-332a774ff4ec): created successfully Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5ce9cb-0a90-4b4d-9275-0f4c0e9c98a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (a4e0be15-0cb4-4ac8-996e-317766d1e94b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d47bca5-b441-42ad-909d-da6b709b6dd4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0f35c8ea-67fc-4151-ae61-707f9d73cfd9 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created volume successfully. Aug 01 15:16:04 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc Aug 01 15:16:04 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:05 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" returned: 0 in 0.378s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:05 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 1G Aug 01 15:16:05 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:05 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 1G" returned: 0 in 0.468s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:05 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 Aug 01 15:16:05 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:05 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7" returned: 0 in 0.349s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:05 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 is being set with open permissions: ugo+rw Aug 01 15:16:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:05 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 Aug 01 15:16:05 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:06 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7" returned: 0 in 0.253s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:06 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.info Aug 01 15:16:06 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:06 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.info" returned: 0 in 0.287s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:06 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.info is being set with open permissions: ugo+rw Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:06 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.info Aug 01 15:16:06 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:06 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.info" returned: 0 in 0.263s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.280s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-607728853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3123306-fcaa-4cd9-9646-d49b25084dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:03Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Creating volume a3123306-fcaa-4cd9-9646-d49b25084dde {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:06 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:06 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde 1073741824 Aug 01 15:16:06 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:06 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-206eaddf-1cf0-42f5-97df-84942e8c2920 tempest-TestVolumeBootPattern-18811166 None] Create snapshot completed successfully Aug 01 15:16:07 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde 1073741824" returned: 0 in 0.617s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:07 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde Aug 01 15:16:07 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:07 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde" returned: 0 in 0.304s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.825s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527900109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50dd7e26-93a1-4906-a9f0-37d77f066f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:04Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Creating volume 50dd7e26-93a1-4906-a9f0-37d77f066f03 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:07 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45259158-b897-45e5-9b23-99ba175f9214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3123306-fcaa-4cd9-9646-d49b25084dde', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69d6f36-2df0-4e00-99b1-c8f6dcad8e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:07 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03 1073741824 Aug 01 15:16:07 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:07 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume volume-a3123306-fcaa-4cd9-9646-d49b25084dde (a3123306-fcaa-4cd9-9646-d49b25084dde): created successfully Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69d6f36-2df0-4e00-99b1-c8f6dcad8e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (ad76c989-bf22-4a81-949a-0f54fc7cbcb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-54c2e836-ebd7-40b5-8ac6-291456e720b2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created volume successfully. Aug 01 15:16:08 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03 1073741824" returned: 0 in 0.543s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:08 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03 Aug 01 15:16:08 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:08 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03" returned: 0 in 0.480s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.504s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-817001579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d94386-9d6a-405c-a336-f307625cef9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1ef42d04174ba5b8dce88f6bbc516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:04Z,use_quota=True,user_id='65421438c7724b86b9e9449061571ee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Creating volume e5d94386-9d6a-405c-a336-f307625cef9e {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:08 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf44bc7-cfcc-48fa-b92f-313b4172271f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50dd7e26-93a1-4906-a9f0-37d77f066f03', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d60b06-0054-4fa5-9ea2-8dbceaad88a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:08 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e 1073741824 Aug 01 15:16:08 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:08 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume volume-50dd7e26-93a1-4906-a9f0-37d77f066f03 (50dd7e26-93a1-4906-a9f0-37d77f066f03): created successfully Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d60b06-0054-4fa5-9ea2-8dbceaad88a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (4a1017ee-f92c-43e4-96c1-cc0a505daa59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0f4b2300-2da9-4ac5-aac4-218e233800a5 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created volume successfully. Aug 01 15:16:09 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e 1073741824" returned: 0 in 0.724s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:09 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e Aug 01 15:16:09 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:10 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e" returned: 0 in 0.428s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d1f3c3-445f-49fd-a488-d5ea223c65fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d94386-9d6a-405c-a336-f307625cef9e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb9cdad-f11e-4c4f-aa9b-41b605fc2b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:10 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Volume volume-e5d94386-9d6a-405c-a336-f307625cef9e (e5d94386-9d6a-405c-a336-f307625cef9e): created successfully Aug 01 15:16:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb9cdad-f11e-4c4f-aa9b-41b605fc2b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Flow 'volume_create_manager' (6cf4fa3f-af23-4152-a5dc-25cb27e52534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cb02fe8c-d798-45bf-83ff-b73a0977b8f4 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created volume successfully. Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Flow 'volume_create_manager' (b66ff5ba-fe6a-4800-80f8-63e2d578bea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef68bf2-dbe1-4f77-bc2a-4c4f06d1b628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef68bf2-dbe1-4f77-bc2a-4c4f06d1b628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-559794315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131016be-ff98-488a-8a9a-2391512e9f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710783729f6443dcb9eedbd0ea3bc71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:11Z,use_quota=True,user_id='bf1a5bb18cc74b74a9e9baf32c2482be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e57582-9bc0-43ff-9c46-775c24a7445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e57582-9bc0-43ff-9c46-775c24a7445f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10ce182-df6d-4ada-8e14-ed89d1dcbd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10ce182-df6d-4ada-8e14-ed89d1dcbd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '131016be-ff98-488a-8a9a-2391512e9f02', 'volume_name': 'volume-131016be-ff98-488a-8a9a-2391512e9f02', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b7c212-4565-4a72-8d6a-ece34d12c563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b7c212-4565-4a72-8d6a-ece34d12c563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c5601c4-4896-47bb-8a57-9209a142ebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:11 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Volume 131016be-ff98-488a-8a9a-2391512e9f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-131016be-ff98-488a-8a9a-2391512e9f02', 'volume_size': 1} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-559794315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=131016be-ff98-488a-8a9a-2391512e9f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710783729f6443dcb9eedbd0ea3bc71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:11Z,use_quota=True,user_id='bf1a5bb18cc74b74a9e9baf32c2482be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Creating volume 131016be-ff98-488a-8a9a-2391512e9f02 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:11 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-e5d94386-9d6a-405c-a336-f307625cef9e-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-e5d94386-9d6a-405c-a336-f307625cef9e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:11 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02 1073741824 Aug 01 15:16:11 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-quobyte-e5d94386-9d6a-405c-a336-f307625cef9e" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-e5d94386-9d6a-405c-a336-f307625cef9e" acquired by "delete_volume" :: waited 0.042s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e35485-17a8-445d-9bb0-b8e7900b9258]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:11 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e Aug 01 15:16:11 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Flow 'volume_create_manager' (e148c291-83b2-4b89-8374-9019ac23ed07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82af323b-d02a-46fc-b835-ff0e0e05cfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82af323b-d02a-46fc-b835-ff0e0e05cfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1025202326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1945757d-c966-4f03-9a91-2ffdd8603a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710783729f6443dcb9eedbd0ea3bc71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:12Z,use_quota=True,user_id='bf1a5bb18cc74b74a9e9baf32c2482be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8064e8-a303-4e4e-8d5c-3e379e331eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8064e8-a303-4e4e-8d5c-3e379e331eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39ad6f8-7a38-4d29-9324-ff626f4d29e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39ad6f8-7a38-4d29-9324-ff626f4d29e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1945757d-c966-4f03-9a91-2ffdd8603a9a', 'volume_name': 'volume-1945757d-c966-4f03-9a91-2ffdd8603a9a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3dbf4fc-f105-45af-b553-8ad773ed058b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3dbf4fc-f105-45af-b553-8ad773ed058b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b790c585-e732-4d9c-965c-dc2cfaf3fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:12 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Volume 1945757d-c966-4f03-9a91-2ffdd8603a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1945757d-c966-4f03-9a91-2ffdd8603a9a', 'volume_size': 1} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:12 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Flow 'volume_create_manager' (11ff4d38-6229-4ba8-82e9-8d70341d6b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:12 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723295f8-ac57-4c2f-91cc-4f9d804639c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02 1073741824" returned: 0 in 0.887s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e" returned: 0 in 0.648s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723295f8-ac57-4c2f-91cc-4f9d804639c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf06e41c-f9a7-49d6-af5c-bb1675769165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0349bd603ac4f78b8ed006909214988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a471d30e-b205-4114-895c-c9ad43e00ad7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:12Z,use_quota=True,user_id='aecd1671caa0449abfcd755f0b5584b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:12 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e Aug 01 15:16:12 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065e3745-0dba-41b8-8431-cafee72dbac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065e3745-0dba-41b8-8431-cafee72dbac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fc2ee3-e10c-4e2f-885c-b8f7516925a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fc2ee3-e10c-4e2f-885c-b8f7516925a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cf06e41c-f9a7-49d6-af5c-bb1675769165', 'volume_name': 'volume-cf06e41c-f9a7-49d6-af5c-bb1675769165', 'volume_size': 1, 'snapshot_id': 'a471d30e-b205-4114-895c-c9ad43e00ad7'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb6f33c6-258b-40aa-b544-742edeb33274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb6f33c6-258b-40aa-b544-742edeb33274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02882fd-76ae-48c8-ba39-87c6350c087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:12 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Volume cf06e41c-f9a7-49d6-af5c-bb1675769165: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cf06e41c-f9a7-49d6-af5c-bb1675769165', 'volume_size': 1, 'snapshot_id': 'a471d30e-b205-4114-895c-c9ad43e00ad7'} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:12 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02 Aug 01 15:16:12 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:12 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e5d94386-9d6a-405c-a336-f307625cef9e" returned: 0 in 0.366s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-e5d94386-9d6a-405c-a336-f307625cef9e" released by "delete_volume" :: held 1.093s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created reservations ['08fd09bf-590d-4b2f-94da-8659304ecd04', '95c62d9b-5a10-4437-b48c-f970ab364b2a', '6be43c64-6852-4098-bdca-06e9a64e186f', '1ec1345c-0f9a-452c-bc1d-9ee70069152f'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:12 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02" returned: 0 in 0.323s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1025202326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1945757d-c966-4f03-9a91-2ffdd8603a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710783729f6443dcb9eedbd0ea3bc71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:12Z,use_quota=True,user_id='bf1a5bb18cc74b74a9e9baf32c2482be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Creating volume 1945757d-c966-4f03-9a91-2ffdd8603a9a {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:12 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:12 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a 1073741824 Aug 01 15:16:12 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c5601c4-4896-47bb-8a57-9209a142ebb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-131016be-ff98-488a-8a9a-2391512e9f02', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51be0cff-0051-4950-ac5e-fa903ac607cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:12 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Volume volume-131016be-ff98-488a-8a9a-2391512e9f02 (131016be-ff98-488a-8a9a-2391512e9f02): created successfully Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51be0cff-0051-4950-ac5e-fa903ac607cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Flow 'volume_create_manager' (b66ff5ba-fe6a-4800-80f8-63e2d578bea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:12 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f955af34-8169-4bbe-b02e-bb85f3f42317 tempest-TestServerVolumeAttachmentScenario-111086386 None] Created volume successfully. Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:12 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:12 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:13 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.332s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:13 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Deleted volume successfully. Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cea3e975-2b01-4af4-9e76-618ad9e724db tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-e5d94386-9d6a-405c-a336-f307625cef9e-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:13 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a 1073741824" returned: 0 in 0.570s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:13 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a Aug 01 15:16:13 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-50dd7e26-93a1-4906-a9f0-37d77f066f03-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-50dd7e26-93a1-4906-a9f0-37d77f066f03-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:13 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a" returned: 0 in 0.339s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.320s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-a471d30e-b205-4114-895c-c9ad43e00ad7-cf06e41c-f9a7-49d6-af5c-bb1675769165" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b790c585-e732-4d9c-965c-dc2cfaf3fe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1945757d-c966-4f03-9a91-2ffdd8603a9a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c9a4db-e96b-4024-b8d4-097d7b181762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-quobyte-50dd7e26-93a1-4906-a9f0-37d77f066f03" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-a471d30e-b205-4114-895c-c9ad43e00ad7-cf06e41c-f9a7-49d6-af5c-bb1675769165" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Creating volume cf06e41c-f9a7-49d6-af5c-bb1675769165 from snapshot a471d30e-b205-4114-895c-c9ad43e00ad7 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-cf06e41c-f9a7-49d6-af5c-bb1675769165" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:13 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Volume volume-1945757d-c966-4f03-9a91-2ffdd8603a9a (1945757d-c966-4f03-9a91-2ffdd8603a9a): created successfully Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c9a4db-e96b-4024-b8d4-097d7b181762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Flow 'volume_create_manager' (e148c291-83b2-4b89-8374-9019ac23ed07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-50dd7e26-93a1-4906-a9f0-37d77f066f03" acquired by "delete_volume" :: waited 0.052s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-cf06e41c-f9a7-49d6-af5c-bb1675769165" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] snapshot: a471d30e-b205-4114-895c-c9ad43e00ad7, volume: cf06e41c-f9a7-49d6-af5c-bb1675769165, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce9f571-2e53-4df2-b571-e35e0c1147f5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:13 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-34840541-a115-4687-8bfa-744388372674 tempest-TestServerVolumeAttachmentScenario-111086386 None] Created volume successfully. Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[67504fa7-0b45-4305-86d6-881190e089de]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:13 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03 Aug 01 15:16:13 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:13 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 Aug 01 15:16:13 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:14 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03" returned: 0 in 0.424s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:14 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03 Aug 01 15:16:14 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:14 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7" returned: 0 in 0.520s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e18afc9-19e0-4cdd-be02-d89063f98534]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:14 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc Aug 01 15:16:14 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:14 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-50dd7e26-93a1-4906-a9f0-37d77f066f03" returned: 0 in 0.353s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-50dd7e26-93a1-4906-a9f0-37d77f066f03" released by "delete_volume" :: held 0.839s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created reservations ['8ec7b6c0-23d4-42c8-8804-db8b2e21da4b', 'd9b71969-02e7-4456-aeb3-0f8c35ae1ca3', 'ea946b97-6b53-4e80-a5b2-f776cd160203', 'e26d88a4-9378-4554-bb17-3bccc5e11535'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:14 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-a3123306-fcaa-4cd9-9646-d49b25084dde-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:14 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-a3123306-fcaa-4cd9-9646-d49b25084dde-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-quobyte-a3123306-fcaa-4cd9-9646-d49b25084dde" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-a3123306-fcaa-4cd9-9646-d49b25084dde" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a26f046-8c59-4290-bed6-f51e514928e4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:14 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" returned: 0 in 0.626s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:16:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:16:15 devstack cinder-volume[89024]: DEBUG cinder.utils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:16:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:15 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 Aug 01 15:16:15 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:15 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde Aug 01 15:16:15 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:15 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.361s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:15 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Deleted volume successfully. Aug 01 15:16:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e4ba072-d28a-45dc-ac17-71f44fde1c73 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-50dd7e26-93a1-4906-a9f0-37d77f066f03-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:15 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde" returned: 0 in 0.452s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:15 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde Aug 01 15:16:15 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:15 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a3123306-fcaa-4cd9-9646-d49b25084dde" returned: 0 in 0.402s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-a3123306-fcaa-4cd9-9646-d49b25084dde" released by "delete_volume" :: held 0.909s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:15 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created reservations ['6ee9b838-d636-49d3-b8b4-15fc6377942a', '6b82b039-7bff-4c1f-9fd6-65e0c5b5c16b', 'a04e44d2-2df4-427c-9222-1779898cc585', '27ddc26d-892c-440d-9e75-c7a9a166ccab'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:16 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:16 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:16 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.327s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:16 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Deleted volume successfully. Aug 01 15:16:16 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165" returned: 0 in 1.479s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc, size 1024.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:16:16 devstack cinder-volume[89024]: INFO cinder.image.image_utils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Converted 1024.00 MB image at 692.24 MB/s Aug 01 15:16:16 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 is being set with open permissions: ugo+rw Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1dd9a414-8d77-434f-8494-b73b4e2693a2 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-a3123306-fcaa-4cd9-9646-d49b25084dde-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:16 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 Aug 01 15:16:16 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:16 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-cf06e41c-f9a7-49d6-af5c-bb1675769165" released by "_copy_volume_from_snapshot" :: held 3.075s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-a471d30e-b205-4114-895c-c9ad43e00ad7-cf06e41c-f9a7-49d6-af5c-bb1675769165" released by "_create_volume_from_snapshot" :: held 3.203s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.254s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Marking volume cf06e41c-f9a7-49d6-af5c-bb1675769165 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Copying metadata from snapshot a471d30e-b205-4114-895c-c9ad43e00ad7 to cf06e41c-f9a7-49d6-af5c-bb1675769165. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02882fd-76ae-48c8-ba39-87c6350c087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf06e41c-f9a7-49d6-af5c-bb1675769165', 'volume_size': 1, 'snapshot_id': 'a471d30e-b205-4114-895c-c9ad43e00ad7'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe767bb-137f-4b6e-b8f4-9b68af8d942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:16 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Volume volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 (cf06e41c-f9a7-49d6-af5c-bb1675769165): created successfully Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe767bb-137f-4b6e-b8f4-9b68af8d942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Flow 'volume_create_manager' (11ff4d38-6229-4ba8-82e9-8d70341d6b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:17 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-d2fba1d6-af49-407e-b06e-020211fa1369 tempest-TestVolumeBootPattern-18811166 None] Created volume successfully. Aug 01 15:16:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-e85c7843-eff6-441b-8a0f-332a774ff4ec-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-e85c7843-eff6-441b-8a0f-332a774ff4ec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-quobyte-e85c7843-eff6-441b-8a0f-332a774ff4ec" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-e85c7843-eff6-441b-8a0f-332a774ff4ec" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:17 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ad684c-5693-4304-8396-57c7fb05b83a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:17 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec Aug 01 15:16:17 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:17 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec" returned: 0 in 0.543s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:17 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec Aug 01 15:16:17 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-cf0a2693-3e38-4491-a17f-92eec7488d55 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-cf0a2693-3e38-4491-a17f-92eec7488d55 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-cf0a2693-3e38-4491-a17f-92eec7488d55 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-cf0a2693-3e38-4491-a17f-92eec7488d55 tempest-TestVolumeBootPattern-18811166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-cf06e41c-f9a7-49d6-af5c-bb1675769165', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fed99a8a-68e5-4f84-890a-023f4e146cc7', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:16:18 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e85c7843-eff6-441b-8a0f-332a774ff4ec" returned: 0 in 0.351s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-6eb6d3d6-9ff5-473b-a11d-6c1fb84ee6da req-cf0a2693-3e38-4491-a17f-92eec7488d55 tempest-TestVolumeBootPattern-18811166 None] attachment_update completed successfully. Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-e85c7843-eff6-441b-8a0f-332a774ff4ec" released by "delete_volume" :: held 0.963s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created reservations ['7cdbd81e-3535-4881-ad94-ec273392ea2d', 'd1df3b91-b797-498f-9916-a8cf02eb239a', 'f8cd5d7e-3438-47ee-ab6a-2c182505097c', 'a2495de5-16cf-487c-95fc-4ecb28b84b40'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:18 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:18 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:18 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:18 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:18 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Deleted volume successfully. Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-179dfe25-50b5-4b4a-a515-ef0cd81ad502 tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-e85c7843-eff6-441b-8a0f-332a774ff4ec-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:18 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.407s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:16:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:16:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:16:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-1e30856e-bbc7-4991-a029-61a72dec5637-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-1e30856e-bbc7-4991-a029-61a72dec5637-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-quobyte-1e30856e-bbc7-4991-a029-61a72dec5637" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-1e30856e-bbc7-4991-a029-61a72dec5637" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01eb435-c8ea-4cf8-ab21-7faaf2f62746]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:19 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637 Aug 01 15:16:19 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:20 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637" returned: 0 in 0.549s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:20 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637 Aug 01 15:16:20 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:20 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1e30856e-bbc7-4991-a029-61a72dec5637" returned: 0 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-1e30856e-bbc7-4991-a029-61a72dec5637" released by "delete_volume" :: held 0.967s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:20 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created reservations ['a4683482-697f-4c98-bcf5-9fcc5ad947de', 'cedc9772-24d9-4434-956e-8db195db73d2', 'bd5aa5e6-2605-4816-a5cc-f4e46a1349ac', 'ecc848c1-dd7f-4267-bf17-211f9a3c7fb6'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:20 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:20 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:21 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:21 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:21 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Deleted volume successfully. Aug 01 15:16:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0fac146c-4c5d-4916-8b5e-c3e078b24e2c tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-1e30856e-bbc7-4991-a029-61a72dec5637-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-31566f74-03ff-4d23-8927-a3253b58904d-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-31566f74-03ff-4d23-8927-a3253b58904d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "cinder-quobyte-31566f74-03ff-4d23-8927-a3253b58904d" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-31566f74-03ff-4d23-8927-a3253b58904d" acquired by "delete_volume" :: waited 0.042s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:22 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4f477f-d598-4ade-876d-6086d72e92b6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:22 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d Aug 01 15:16:22 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:23 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d" returned: 0 in 0.986s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:23 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d Aug 01 15:16:23 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:23 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-31566f74-03ff-4d23-8927-a3253b58904d" returned: 0 in 0.404s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-quobyte-31566f74-03ff-4d23-8927-a3253b58904d" released by "delete_volume" :: held 1.505s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:23 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Created reservations ['acd79332-39c4-4451-9f77-f850bb808195', '6928bc8a-2c68-43fb-af35-30918754d236', '82ba7901-f5ab-4792-8363-cee9bce49b1e', '75e86b4a-5603-4e0a-a058-fca1498fc168'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:23 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:23 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:24 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.367s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:24 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:24 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Deleted volume successfully. Aug 01 15:16:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8e01d154-6a6e-487a-9a22-9257e584c15d tempest-CreateVolumesFromSourceVolumeTest-714297877 None] Lock "cinder-31566f74-03ff-4d23-8927-a3253b58904d-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:27 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-52892e74-ac8a-4c44-b73b-3e043963fb00 tempest-TestVolumeBootPattern-18811166 None] Terminate volume connection completed successfully. Aug 01 15:16:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-52892e74-ac8a-4c44-b73b-3e043963fb00 tempest-TestVolumeBootPattern-18811166 None] Deleting attachment fed99a8a-68e5-4f84-890a-023f4e146cc7. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:16:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-cf06e41c-f9a7-49d6-af5c-bb1675769165-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-cf06e41c-f9a7-49d6-af5c-bb1675769165-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-cf06e41c-f9a7-49d6-af5c-bb1675769165" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-cf06e41c-f9a7-49d6-af5c-bb1675769165" acquired by "delete_volume" :: waited 0.040s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:28 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab66e62-a85d-4751-b3a1-33f9c669c77d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:28 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 Aug 01 15:16:28 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:28 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165" returned: 0 in 0.765s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:28 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165 Aug 01 15:16:28 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:29 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf06e41c-f9a7-49d6-af5c-bb1675769165" returned: 0 in 0.435s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-cf06e41c-f9a7-49d6-af5c-bb1675769165" released by "delete_volume" :: held 1.301s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.quota [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Created reservations ['4f6faa05-b0fd-4411-a5e1-a657b1837d89', '81625989-58fe-407c-91eb-1342529be76c', 'f91a481f-f084-4458-a4c2-5e8f2afd987b', '10eafb55-4818-4cb2-832f-39b18c13feb1'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:29 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:29 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:29 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.259s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.manager [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:29 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Deleted volume successfully. Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (ba4847b3-f316-470f-8efe-250d398cc2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac98ecc2-1321-4687-b672-d8b607c50d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-a9cf7e5b-68ba-4edb-b672-4c8d042f2525 req-535433fc-26a2-4944-8a0f-ba073ad27cd7 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-cf06e41c-f9a7-49d6-af5c-bb1675769165-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac98ecc2-1321-4687-b672-d8b607c50d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-984962535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea82d48d-f56a-42c5-aa62-4beef1381d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:30Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89355b1-81a4-4161-89cc-99af7cf69303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89355b1-81a4-4161-89cc-99af7cf69303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249bdf79-cf95-4e2e-840e-92c5c6a8a6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249bdf79-cf95-4e2e-840e-92c5c6a8a6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea82d48d-f56a-42c5-aa62-4beef1381d89', 'volume_name': 'volume-ea82d48d-f56a-42c5-aa62-4beef1381d89', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5cda8f-04f8-4ed6-928b-d105651760b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5cda8f-04f8-4ed6-928b-d105651760b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5936b05-e968-4ee5-b3b4-3adcf621547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:29 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Volume ea82d48d-f56a-42c5-aa62-4beef1381d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea82d48d-f56a-42c5-aa62-4beef1381d89', 'volume_size': 1} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-984962535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea82d48d-f56a-42c5-aa62-4beef1381d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:30Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Creating volume ea82d48d-f56a-42c5-aa62-4beef1381d89 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:29 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:29 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 1073741824 Aug 01 15:16:29 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-a471d30e-b205-4114-895c-c9ad43e00ad7-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-a471d30e-b205-4114-895c-c9ad43e00ad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-a471d30e-b205-4114-895c-c9ad43e00ad7" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-a471d30e-b205-4114-895c-c9ad43e00ad7" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Deleting offline snapshot a471d30e-b205-4114-895c-c9ad43e00ad7 of volume 820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] snapshot_file for this snap is: volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6832076-d6bb-46bf-ae5b-4a431f286c46]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:30 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 Aug 01 15:16:30 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:30 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 1073741824" returned: 0 in 0.586s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:30 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 Aug 01 15:16:30 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:30 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7" returned: 0 in 0.512s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1b5af8-09c5-40a9-a02e-dbbf64e7012e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:30 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89" returned: 0 in 0.353s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5936b05-e968-4ee5-b3b4-3adcf621547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea82d48d-f56a-42c5-aa62-4beef1381d89', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099a40a9-f52b-484c-ba74-0ec775d78b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:30 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc Aug 01 15:16:30 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:30 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Volume volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 (ea82d48d-f56a-42c5-aa62-4beef1381d89): created successfully Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099a40a9-f52b-484c-ba74-0ec775d78b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (ba4847b3-f316-470f-8efe-250d398cc2fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:30 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-66568633-24f8-4a9a-9f5d-4818bc05ed1c tempest-VolumeDependencyTests-1300175653 None] Created volume successfully. Aug 01 15:16:31 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" returned: 0 in 0.404s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:31 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 Aug 01 15:16:31 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:31 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7" returned: 0 in 0.324s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:31 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7 Aug 01 15:16:31 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:31 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc.a471d30e-b205-4114-895c-c9ad43e00ad7" returned: 0 in 0.252s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-a471d30e-b205-4114-895c-c9ad43e00ad7" released by "_delete_snapshot" :: held 1.630s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" released by "delete_snapshot" :: held 1.677s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:31 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Created reservations ['d1fa109f-120f-4638-960d-a06f41417e0e', '8836cc44-b11a-4dae-9698-9fc9e27fdde8', '3ed9b70d-865e-4c64-a524-144dccebe4b7', '9d3abb8d-2b4b-44b0-810d-04756cc436f6'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:32 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Delete snapshot completed successfully. Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7c37f91e-e78f-449c-b146-5d50a1ddb2fc tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-a471d30e-b205-4114-895c-c9ad43e00ad7-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] Creating offline snapshot 71999240-b0c0-4ab2-a4c0-55ea665c3b7e of volume ea82d48d-f56a-42c5-aa62-4beef1381d89 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f98ae5-82c8-49aa-8778-a1171eb0a523]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:32 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 Aug 01 15:16:32 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-820da1fe-9a4f-4ba3-a63f-bcc352d365cc-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-820da1fe-9a4f-4ba3-a63f-bcc352d365cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "cinder-quobyte-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1db00c-3c45-4afd-9b51-62c9369149ce]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:32 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89" returned: 0 in 0.413s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:32 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc Aug 01 15:16:32 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:32 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e 1G Aug 01 15:16:32 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:32 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" returned: 0 in 0.392s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:32 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc Aug 01 15:16:32 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:32 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e 1G" returned: 0 in 0.422s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:33 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e Aug 01 15:16:33 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:33 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" returned: 0 in 0.285s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-quobyte-820da1fe-9a4f-4ba3-a63f-bcc352d365cc" released by "delete_volume" :: held 0.736s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Created reservations ['609d323e-b4e4-48d4-8062-efcb8d8ed58c', '50e98ddc-c779-4a70-b176-00f831c242d4', '7abf892a-a437-4521-9166-14de8b0f523a', '7ef4b98f-3350-483a-a11e-9464bbcf0bcc'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:33 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e" returned: 0 in 0.362s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:33 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e is being set with open permissions: ugo+rw Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:33 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:33 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:33 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e Aug 01 15:16:33 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:33 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e" returned: 0 in 0.262s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:33 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.346s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:33 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Deleted volume successfully. Aug 01 15:16:33 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.info Aug 01 15:16:33 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-63d45fa5-bfdd-4162-ad90-12b028cfb6a7 tempest-TestVolumeBootPattern-18811166 None] Lock "cinder-820da1fe-9a4f-4ba3-a63f-bcc352d365cc-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:33 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.info" returned: 0 in 0.301s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:33 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.info is being set with open permissions: ugo+rw Aug 01 15:16:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:33 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.info Aug 01 15:16:33 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:34 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.info" returned: 0 in 0.301s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:34 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-112934ee-bee4-4f22-babd-30c4ce7778c7 tempest-VolumeDependencyTests-1300175653 None] Create snapshot completed successfully Aug 01 15:16:35 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=157,cinder:INSERT=68,cinder:UPDATE=176,cinder:DELETE=15 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (94b3e4df-10c5-4a33-8a96-de58fc840b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8690509-57dd-4051-bbb2-7ae267480a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8690509-57dd-4051-bbb2-7ae267480a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-130072063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91948e5-819b-4d3f-854f-b4f054072969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=71999240-b0c0-4ab2-a4c0-55ea665c3b7e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:36Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb3e1ae-6f3c-40f2-8521-96fb0e935b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb3e1ae-6f3c-40f2-8521-96fb0e935b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415e8874-0aad-4907-b730-d69ff7c4ad1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415e8874-0aad-4907-b730-d69ff7c4ad1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd91948e5-819b-4d3f-854f-b4f054072969', 'volume_name': 'volume-d91948e5-819b-4d3f-854f-b4f054072969', 'volume_size': 1, 'snapshot_id': '71999240-b0c0-4ab2-a4c0-55ea665c3b7e'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce10bad-131c-41d3-b001-ee4a10a12507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce10bad-131c-41d3-b001-ee4a10a12507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25bddef-f5c0-428e-9cbb-2e7207bf7ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:36 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Volume d91948e5-819b-4d3f-854f-b4f054072969: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d91948e5-819b-4d3f-854f-b4f054072969', 'volume_size': 1, 'snapshot_id': '71999240-b0c0-4ab2-a4c0-55ea665c3b7e'} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-71999240-b0c0-4ab2-a4c0-55ea665c3b7e-d91948e5-819b-4d3f-854f-b4f054072969" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-71999240-b0c0-4ab2-a4c0-55ea665c3b7e-d91948e5-819b-4d3f-854f-b4f054072969" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Creating volume d91948e5-819b-4d3f-854f-b4f054072969 from snapshot 71999240-b0c0-4ab2-a4c0-55ea665c3b7e {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-d91948e5-819b-4d3f-854f-b4f054072969" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d91948e5-819b-4d3f-854f-b4f054072969" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] snapshot: 71999240-b0c0-4ab2-a4c0-55ea665c3b7e, volume: d91948e5-819b-4d3f-854f-b4f054072969, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[20251569-08a6-4c7a-8b06-5dc525abf0de]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:36 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e Aug 01 15:16:36 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:36 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e" returned: 0 in 0.449s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea82d48d-f56a-42c5-aa62-4beef1381d89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc642ba7-63bc-4847-9343-30ce149af299]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:36 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 Aug 01 15:16:36 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:37 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89" returned: 0 in 0.402s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:16:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:16:37 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:16:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:37 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 Aug 01 15:16:37 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:42 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969" returned: 0 in 5.314s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:16:42 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Converted 1024.00 MB image at 192.65 MB/s Aug 01 15:16:42 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 is being set with open permissions: ugo+rw Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:42 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 Aug 01 15:16:42 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:42 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d91948e5-819b-4d3f-854f-b4f054072969" released by "_copy_volume_from_snapshot" :: held 6.536s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=181,cinder:SELECT=146,cinder:INSERT=64,cinder:DELETE=14 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-71999240-b0c0-4ab2-a4c0-55ea665c3b7e-d91948e5-819b-4d3f-854f-b4f054072969" released by "_create_volume_from_snapshot" :: held 6.624s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.642s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25bddef-f5c0-428e-9cbb-2e7207bf7ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d91948e5-819b-4d3f-854f-b4f054072969', 'volume_size': 1, 'snapshot_id': '71999240-b0c0-4ab2-a4c0-55ea665c3b7e'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbf2978-39e7-4620-8c11-a00ba157cba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:42 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Volume volume-d91948e5-819b-4d3f-854f-b4f054072969 (d91948e5-819b-4d3f-854f-b4f054072969): created successfully Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbf2978-39e7-4620-8c11-a00ba157cba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (94b3e4df-10c5-4a33-8a96-de58fc840b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-039bc02b-f7b9-4f8a-9179-76a081d9a965 tempest-VolumeDependencyTests-1300175653 None] Created volume successfully. Aug 01 15:16:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] Creating offline snapshot af7b8777-74e9-441c-951a-1bf195d55551 of volume d91948e5-819b-4d3f-854f-b4f054072969 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:16:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cd0877-4967-4297-9f5b-9d6bc94d484f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:44 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 Aug 01 15:16:44 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:44 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969" returned: 0 in 0.375s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:44 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 1G Aug 01 15:16:44 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:44 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 1G" returned: 0 in 0.508s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91948e5-819b-4d3f-854f-b4f054072969 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:44 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91948e5-819b-4d3f-854f-b4f054072969 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 Aug 01 15:16:44 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:45 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91948e5-819b-4d3f-854f-b4f054072969 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551" returned: 0 in 0.359s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:45 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 is being set with open permissions: ugo+rw Aug 01 15:16:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:45 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 Aug 01 15:16:45 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:45 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:45 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.info Aug 01 15:16:45 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:45 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.info" returned: 0 in 0.272s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:45 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.info is being set with open permissions: ugo+rw Aug 01 15:16:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:45 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.info Aug 01 15:16:45 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:46 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.info" returned: 0 in 0.269s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:46 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c8bac42e-0308-4da4-a453-3f453a7392e1 tempest-VolumeDependencyTests-1300175653 None] Create snapshot completed successfully Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (0b0fa220-b955-4a35-b3f7-d639a58f8b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43dfce9-d878-40ca-9ae2-0aa83f7ab6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43dfce9-d878-40ca-9ae2-0aa83f7ab6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-777601807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e1b21d-440b-4ab9-b936-ccb597b70fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=af7b8777-74e9-441c-951a-1bf195d55551,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:47Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bc5366-8611-4e54-8414-2e5b1a8538fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bc5366-8611-4e54-8414-2e5b1a8538fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832c1fdd-3a73-4155-b9f8-7ba7bc07159d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832c1fdd-3a73-4155-b9f8-7ba7bc07159d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '77e1b21d-440b-4ab9-b936-ccb597b70fc8', 'volume_name': 'volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8', 'volume_size': 1, 'snapshot_id': 'af7b8777-74e9-441c-951a-1bf195d55551'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804c91cf-9e7f-436a-8610-5cb013cb5afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804c91cf-9e7f-436a-8610-5cb013cb5afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a754908-9974-4ad9-b266-fe9eeec216a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Volume 77e1b21d-440b-4ab9-b936-ccb597b70fc8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8', 'volume_size': 1, 'snapshot_id': 'af7b8777-74e9-441c-951a-1bf195d55551'} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-af7b8777-74e9-441c-951a-1bf195d55551-77e1b21d-440b-4ab9-b936-ccb597b70fc8" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-af7b8777-74e9-441c-951a-1bf195d55551-77e1b21d-440b-4ab9-b936-ccb597b70fc8" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Creating volume 77e1b21d-440b-4ab9-b936-ccb597b70fc8 from snapshot af7b8777-74e9-441c-951a-1bf195d55551 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-77e1b21d-440b-4ab9-b936-ccb597b70fc8" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-77e1b21d-440b-4ab9-b936-ccb597b70fc8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] snapshot: af7b8777-74e9-441c-951a-1bf195d55551, volume: 77e1b21d-440b-4ab9-b936-ccb597b70fc8, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d109d25f-d59e-423e-9f70-0481ba226b4a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Flow 'volume_create_manager' (13c167f0-de2e-4809-acbe-90f3f5df845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:47 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 Aug 01 15:16:47 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f8f2d4-f5a2-404e-8b3a-8c148d9c7b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f8f2d4-f5a2-404e-8b3a-8c148d9c7b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1387317073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9381432f-a81d-4702-b14e-74b1053d1cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e75a9118dd4f9ebbc6bea79f598dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:48Z,use_quota=True,user_id='703e0bf4462f432e833cfcc5bf536216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e632bbc-145f-4273-8fb9-a5bea30ecbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e632bbc-145f-4273-8fb9-a5bea30ecbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55eb8da-34c3-4d43-ae74-333ebb950d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55eb8da-34c3-4d43-ae74-333ebb950d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9381432f-a81d-4702-b14e-74b1053d1cee', 'volume_name': 'volume-9381432f-a81d-4702-b14e-74b1053d1cee', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b0d8d9-a282-4cb9-9d48-e1f1aa8cc44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b0d8d9-a282-4cb9-9d48-e1f1aa8cc44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aeaa25c-012c-4edc-8fc7-ad3fef6516e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Volume 9381432f-a81d-4702-b14e-74b1053d1cee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9381432f-a81d-4702-b14e-74b1053d1cee', 'volume_size': 1} Aug 01 15:16:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:48 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551" returned: 0 in 0.423s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91948e5-819b-4d3f-854f-b4f054072969(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af0aac2-6a10-4556-b865-a3ba5488d1d4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Flow 'volume_create_manager' (c300b698-0a82-4da2-a9dc-9bca734ddae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ff32c6-5ab2-4692-810c-73843af966df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ff32c6-5ab2-4692-810c-73843af966df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084897467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d141a8-1bff-487b-945d-6ac525b086a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e75a9118dd4f9ebbc6bea79f598dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:48Z,use_quota=True,user_id='703e0bf4462f432e833cfcc5bf536216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef747cf-c163-49e2-9592-35c31ffa8189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef747cf-c163-49e2-9592-35c31ffa8189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff40c3b-8dc7-4713-b565-221b99e3d701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff40c3b-8dc7-4713-b565-221b99e3d701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d141a8-1bff-487b-945d-6ac525b086a3', 'volume_name': 'volume-b7d141a8-1bff-487b-945d-6ac525b086a3', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:48 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 Aug 01 15:16:48 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785a9e12-9faf-45a9-8007-5edcf1ec9e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785a9e12-9faf-45a9-8007-5edcf1ec9e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9155c852-7008-4126-9f99-00d96d51ae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:48 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Volume b7d141a8-1bff-487b-945d-6ac525b086a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d141a8-1bff-487b-945d-6ac525b086a3', 'volume_size': 1} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:48 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969" returned: 0 in 0.417s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:48 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 Aug 01 15:16:48 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Flow 'volume_create_manager' (18128a99-4439-44c9-be89-cbd40b004430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06692194-6fcc-44d4-8de9-2bd28ffcc8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06692194-6fcc-44d4-8de9-2bd28ffcc8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-791188185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568dfbe4-f75b-42f9-b4f5-ab154a8288f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e75a9118dd4f9ebbc6bea79f598dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:49Z,use_quota=True,user_id='703e0bf4462f432e833cfcc5bf536216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6f20cf-666c-426d-b177-ca398f100c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6f20cf-666c-426d-b177-ca398f100c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e600d6-3130-415e-b532-13bd2ba5f331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e600d6-3130-415e-b532-13bd2ba5f331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568dfbe4-f75b-42f9-b4f5-ab154a8288f7', 'volume_name': 'volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e3d301-c8e2-41e2-bee0-8e30e7cf39b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e3d301-c8e2-41e2-bee0-8e30e7cf39b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6966fd-f545-4896-bf4e-9bf7af93ff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:48 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Volume 568dfbe4-f75b-42f9-b4f5-ab154a8288f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7', 'volume_size': 1} Aug 01 15:16:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Flow 'volume_create_manager' (9d32c692-c3a7-4688-a367-4a8378970d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6eeae95-6eb5-4dc9-a2ab-6cb3136248c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6eeae95-6eb5-4dc9-a2ab-6cb3136248c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003412863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e75a9118dd4f9ebbc6bea79f598dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:49Z,use_quota=True,user_id='703e0bf4462f432e833cfcc5bf536216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0be0d8d-8bc2-4656-b6f4-e5379817f75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0be0d8d-8bc2-4656-b6f4-e5379817f75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca6a6a8-d16e-4a6f-93b4-24ae841fea1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca6a6a8-d16e-4a6f-93b4-24ae841fea1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3', 'volume_name': 'volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5a6459-2b90-415c-9b18-5568b6e7c80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5a6459-2b90-415c-9b18-5568b6e7c80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea01ae79-9323-49f8-a839-b4608ca65bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:49 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Volume f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3', 'volume_size': 1} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:49 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8" returned: 0 in 0.617s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:16:49 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 01 15:16:49 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 is being set with open permissions: ugo+rw Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:49 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 Aug 01 15:16:49 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Flow 'volume_create_manager' (495cc3d5-66b4-4256-bb9a-e2d5604e2910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:49 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77637c44-667f-4c41-88ff-d67c54040474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8" returned: 0 in 0.321s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77637c44-667f-4c41-88ff-d67c54040474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446390821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf63130f-d6af-4869-8f42-dc930cf7218e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e75a9118dd4f9ebbc6bea79f598dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:49Z,use_quota=True,user_id='703e0bf4462f432e833cfcc5bf536216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0942f2-cb1a-47cf-946f-5a42cb3e60d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0942f2-cb1a-47cf-946f-5a42cb3e60d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c11ac2-5f91-4a41-ae0c-1307192278e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c11ac2-5f91-4a41-ae0c-1307192278e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf63130f-d6af-4869-8f42-dc930cf7218e', 'volume_name': 'volume-cf63130f-d6af-4869-8f42-dc930cf7218e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93fd30f-e696-44d1-b95c-6798c7bdf2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93fd30f-e696-44d1-b95c-6798c7bdf2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669c0561-7192-4e2a-baf1-ab8ee98d35d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:49 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Volume cf63130f-d6af-4869-8f42-dc930cf7218e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf63130f-d6af-4869-8f42-dc930cf7218e', 'volume_size': 1} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-77e1b21d-440b-4ab9-b936-ccb597b70fc8" released by "_copy_volume_from_snapshot" :: held 1.926s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-af7b8777-74e9-441c-951a-1bf195d55551-77e1b21d-440b-4ab9-b936-ccb597b70fc8" released by "_create_volume_from_snapshot" :: held 1.996s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.018s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.728s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1387317073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9381432f-a81d-4702-b14e-74b1053d1cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e75a9118dd4f9ebbc6bea79f598dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:48Z,use_quota=True,user_id='703e0bf4462f432e833cfcc5bf536216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Creating volume 9381432f-a81d-4702-b14e-74b1053d1cee {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:49 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:49 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee 1073741824 Aug 01 15:16:49 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a754908-9974-4ad9-b266-fe9eeec216a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8', 'volume_size': 1, 'snapshot_id': 'af7b8777-74e9-441c-951a-1bf195d55551'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d06bc91-28ef-4a98-b96c-cac8370965e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:49 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Volume volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 (77e1b21d-440b-4ab9-b936-ccb597b70fc8): created successfully Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d06bc91-28ef-4a98-b96c-cac8370965e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (0b0fa220-b955-4a35-b3f7-d639a58f8b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:49 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-04bd02a6-a7e2-4715-8445-72911f488330 tempest-VolumeDependencyTests-1300175653 None] Created volume successfully. Aug 01 15:16:50 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee 1073741824" returned: 0 in 0.541s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-059e441a-086d-48f9-8db5-919064470e36 req-5bbb90d2-eb09-4b50-b5df-bebeba22ed6c tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:50 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee Aug 01 15:16:50 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:50 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee" returned: 0 in 0.258s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.194s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1084897467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d141a8-1bff-487b-945d-6ac525b086a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e75a9118dd4f9ebbc6bea79f598dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:48Z,use_quota=True,user_id='703e0bf4462f432e833cfcc5bf536216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Creating volume b7d141a8-1bff-487b-945d-6ac525b086a3 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:50 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:50 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3 1073741824 Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aeaa25c-012c-4edc-8fc7-ad3fef6516e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9381432f-a81d-4702-b14e-74b1053d1cee', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:50 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de602c59-2560-4243-88a4-dbbdc4bc7bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:50 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Volume volume-9381432f-a81d-4702-b14e-74b1053d1cee (9381432f-a81d-4702-b14e-74b1053d1cee): created successfully Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de602c59-2560-4243-88a4-dbbdc4bc7bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Flow 'volume_create_manager' (13c167f0-de2e-4809-acbe-90f3f5df845e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-04f2c122-7be2-4bc2-b30e-a539850aec44 tempest-CreateVolumesFromImageTest-1239985659 None] Created volume successfully. Aug 01 15:16:50 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3 1073741824" returned: 0 in 0.453s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:51 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3 Aug 01 15:16:51 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (f811ee26-5ce1-4de5-a3fa-6a01315bc216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b923868-d156-48b9-b24f-e84d97c6f74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:51 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3" returned: 0 in 0.280s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.576s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-791188185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568dfbe4-f75b-42f9-b4f5-ab154a8288f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e75a9118dd4f9ebbc6bea79f598dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:49Z,use_quota=True,user_id='703e0bf4462f432e833cfcc5bf536216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Creating volume 568dfbe4-f75b-42f9-b4f5-ab154a8288f7 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:51 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b923868-d156-48b9-b24f-e84d97c6f74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-366846864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d283609b-fc90-4cad-a130-6222f8405707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=77e1b21d-440b-4ab9-b936-ccb597b70fc8,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:51Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d26a50-ca41-43a0-944b-cf49a8fcad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:51 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7 1073741824 Aug 01 15:16:51 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d26a50-ca41-43a0-944b-cf49a8fcad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb76c67-b300-46a9-92b6-6c6358573ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9155c852-7008-4126-9f99-00d96d51ae80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d141a8-1bff-487b-945d-6ac525b086a3', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50806c8a-d2ed-4a0b-b94a-653affbcc7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb76c67-b300-46a9-92b6-6c6358573ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd283609b-fc90-4cad-a130-6222f8405707', 'volume_name': 'volume-d283609b-fc90-4cad-a130-6222f8405707', 'volume_size': 1, 'source_volid': '77e1b21d-440b-4ab9-b936-ccb597b70fc8', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a87e6b-7d94-4436-9544-f2367e225ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a87e6b-7d94-4436-9544-f2367e225ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b152f0-756c-4401-a017-807bffc867ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:51 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Volume d283609b-fc90-4cad-a130-6222f8405707: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d283609b-fc90-4cad-a130-6222f8405707', 'volume_size': 1, 'source_volid': '77e1b21d-440b-4ab9-b936-ccb597b70fc8', 'source_volstatus': 'available'} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:51 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Volume volume-b7d141a8-1bff-487b-945d-6ac525b086a3 (b7d141a8-1bff-487b-945d-6ac525b086a3): created successfully Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50806c8a-d2ed-4a0b-b94a-653affbcc7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Flow 'volume_create_manager' (c300b698-0a82-4da2-a9dc-9bca734ddae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3dd9f5ea-abb3-41a2-b011-4fa11e454590 tempest-CreateVolumesFromImageTest-1239985659 None] Created volume successfully. Aug 01 15:16:51 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7 1073741824" returned: 0 in 0.441s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:51 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7 Aug 01 15:16:51 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:52 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7" returned: 0 in 0.237s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.853s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003412863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e75a9118dd4f9ebbc6bea79f598dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:49Z,use_quota=True,user_id='703e0bf4462f432e833cfcc5bf536216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Creating volume f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:52 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6966fd-f545-4896-bf4e-9bf7af93ff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df917cde-3fde-4198-a7d9-eed8c16ec7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:52 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3 1073741824 Aug 01 15:16:52 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Volume volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7 (568dfbe4-f75b-42f9-b4f5-ab154a8288f7): created successfully Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df917cde-3fde-4198-a7d9-eed8c16ec7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Flow 'volume_create_manager' (18128a99-4439-44c9-be89-cbd40b004430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-365ff56a-b097-4c9a-8cdf-c27efa36802c tempest-CreateVolumesFromImageTest-1239985659 None] Created volume successfully. Aug 01 15:16:52 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3 1073741824" returned: 0 in 0.439s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:52 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3 Aug 01 15:16:52 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:52 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3" returned: 0 in 0.254s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.175s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446390821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf63130f-d6af-4869-8f42-dc930cf7218e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e75a9118dd4f9ebbc6bea79f598dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:16:49Z,use_quota=True,user_id='703e0bf4462f432e833cfcc5bf536216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Creating volume cf63130f-d6af-4869-8f42-dc930cf7218e {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:16:52 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea01ae79-9323-49f8-a839-b4608ca65bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:52 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e 1073741824 Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc15c4cc-2dea-4630-ab27-647a3c57dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:52 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Volume volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3 (f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3): created successfully Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc15c4cc-2dea-4630-ab27-647a3c57dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Flow 'volume_create_manager' (9d32c692-c3a7-4688-a367-4a8378970d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d7073b56-8ba0-4b13-9bdf-114d0ad28655 tempest-CreateVolumesFromImageTest-1239985659 None] Created volume successfully. Aug 01 15:16:53 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e 1073741824" returned: 0 in 0.429s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:53 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e Aug 01 15:16:53 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:53 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e" returned: 0 in 0.251s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-059e441a-086d-48f9-8db5-919064470e36 req-5bbb90d2-eb09-4b50-b5df-bebeba22ed6c tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.242s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-059e441a-086d-48f9-8db5-919064470e36 req-5bbb90d2-eb09-4b50-b5df-bebeba22ed6c tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.093s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:53 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Cloning volume 77e1b21d-440b-4ab9-b936-ccb597b70fc8 to volume d283609b-fc90-4cad-a130-6222f8405707 Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669c0561-7192-4e2a-baf1-ab8ee98d35d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf63130f-d6af-4869-8f42-dc930cf7218e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01477cea-430d-4cbb-8695-8e461e8322a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:53 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Volume volume-cf63130f-d6af-4869-8f42-dc930cf7218e (cf63130f-d6af-4869-8f42-dc930cf7218e): created successfully Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01477cea-430d-4cbb-8695-8e461e8322a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Flow 'volume_create_manager' (495cc3d5-66b4-4256-bb9a-e2d5604e2910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-87f8586a-a79f-43f5-b95b-2ede764a6d01 tempest-CreateVolumesFromImageTest-1239985659 None] Created volume successfully. Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-059e441a-086d-48f9-8db5-919064470e36 req-5bbb90d2-eb09-4b50-b5df-bebeba22ed6c tempest-TestServerVolumeAttachmentScenario-111086386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-131016be-ff98-488a-8a9a-2391512e9f02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11ab8e80-b56a-4ba9-b6e7-0b72c37b2f5a', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Creating offline snapshot 09f2c9b5-0cd2-4cb2-ba59-9209b60147ad of volume 77e1b21d-440b-4ab9-b936-ccb597b70fc8 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ab21e5-1993-41e8-9101-7541c6ddad10]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-059e441a-086d-48f9-8db5-919064470e36 req-5bbb90d2-eb09-4b50-b5df-bebeba22ed6c tempest-TestServerVolumeAttachmentScenario-111086386 None] attachment_update completed successfully. Aug 01 15:16:53 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 Aug 01 15:16:53 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "cinder-cf63130f-d6af-4869-8f42-dc930cf7218e-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-cf63130f-d6af-4869-8f42-dc930cf7218e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "cinder-quobyte-cf63130f-d6af-4869-8f42-dc930cf7218e" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-quobyte-cf63130f-d6af-4869-8f42-dc930cf7218e" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:54 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8" returned: 0 in 0.443s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9548f16-1409-49b5-9365-ba8fde59022d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:54 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad 1G Aug 01 15:16:54 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:54 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e Aug 01 15:16:54 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:54 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e" returned: 0 in 0.450s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:54 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e Aug 01 15:16:54 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:54 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad 1G" returned: 0 in 0.526s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:54 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad Aug 01 15:16:54 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:54 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-cf63130f-d6af-4869-8f42-dc930cf7218e" returned: 0 in 0.272s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-quobyte-cf63130f-d6af-4869-8f42-dc930cf7218e" released by "delete_volume" :: held 0.775s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Created reservations ['c5a7789c-58b4-4400-b808-576b654cb5f5', '0acde57d-d46c-4644-892b-b79fd4644b34', '25bdadd7-54b5-4b2b-97ba-a2d9cb0e70d3', '710bedef-3710-4093-9dd8-8849fa8df6fb'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:54 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad" returned: 0 in 0.308s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:54 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad is being set with open permissions: ugo+rw Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:54 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad Aug 01 15:16:54 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:55 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:55 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "cinder-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:55 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad" returned: 0 in 0.273s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "cinder-quobyte-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-quobyte-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:55 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa53eec-643e-4c47-906b-94b4d028d5c3]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:55 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.info Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.303s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:55 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Deleted volume successfully. Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9d215b6f-25d3-49af-9621-37b7f773ddd1 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-cf63130f-d6af-4869-8f42-dc930cf7218e-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:55 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3 Aug 01 15:16:55 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:55 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.info" returned: 0 in 0.268s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:55 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.info is being set with open permissions: ugo+rw Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:55 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.info Aug 01 15:16:55 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:55 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3" returned: 0 in 0.425s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:55 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3 Aug 01 15:16:55 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:55 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.info" returned: 0 in 0.253s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-d283609b-fc90-4cad-a130-6222f8405707" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d283609b-fc90-4cad-a130-6222f8405707" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] snapshot: 09f2c9b5-0cd2-4cb2-ba59-9209b60147ad, volume: d283609b-fc90-4cad-a130-6222f8405707, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d9bf5e-9587-4073-b0eb-75e1b701e9be]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:55 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3" returned: 0 in 0.277s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:56 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad Aug 01 15:16:56 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-quobyte-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3" released by "delete_volume" :: held 0.750s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Created reservations ['fa32be9b-f5a3-408a-83be-a4308a665817', '0c996950-3510-41dc-84b8-799fd3590678', 'ff9e62b5-fd9f-4578-b4cb-0f5905df34f0', '9d88f318-9ee5-4d54-be9c-c02b3b666424'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:56 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:56 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:56 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad" returned: 0 in 0.392s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deb4f4c-280b-4fc1-9fbb-5b05c6d08ef5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:56 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 Aug 01 15:16:56 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:56 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.314s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Deleted volume successfully. Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "cinder-568dfbe4-f75b-42f9-b4f5-ab154a8288f7-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0cf83dfe-28ca-4335-972b-03afca8fb828 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-f68c3d6b-7e9a-4010-8db7-35a71e5dc7b3-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-568dfbe4-f75b-42f9-b4f5-ab154a8288f7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "cinder-quobyte-568dfbe4-f75b-42f9-b4f5-ab154a8288f7" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-quobyte-568dfbe4-f75b-42f9-b4f5-ab154a8288f7" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[048138b0-345d-4bf5-ae04-e4633f3f70e3]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:56 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8" returned: 0 in 0.442s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:16:56 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7 Aug 01 15:16:56 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:16:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:56 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707 Aug 01 15:16:56 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:57 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7" returned: 0 in 0.413s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:57 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7 Aug 01 15:16:57 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:57 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707" returned: 0 in 0.519s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:16:57 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 01 15:16:57 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707 is being set with open permissions: ugo+rw Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:57 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707 Aug 01 15:16:57 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:57 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-568dfbe4-f75b-42f9-b4f5-ab154a8288f7" returned: 0 in 0.301s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-quobyte-568dfbe4-f75b-42f9-b4f5-ab154a8288f7" released by "delete_volume" :: held 0.763s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Created reservations ['86ee867c-d3e6-490c-b5bc-97c89953a2ac', 'f5a4cf0b-3da1-490e-b230-126740efcddb', 'abf13802-5c52-427c-9323-7e2d8a280384', '819c9ebf-e002-45de-921c-24bd4174b4b2'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:57 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:57 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:57 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707" returned: 0 in 0.306s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d283609b-fc90-4cad-a130-6222f8405707" released by "_copy_volume_from_snapshot" :: held 1.743s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-09f2c9b5-0cd2-4cb2-ba59-9209b60147ad" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-09f2c9b5-0cd2-4cb2-ba59-9209b60147ad" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Deleting offline snapshot 09f2c9b5-0cd2-4cb2-ba59-9209b60147ad of volume 77e1b21d-440b-4ab9-b936-ccb597b70fc8 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] snapshot_file for this snap is: volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[250bf090-d3d3-4b7b-85c2-5b72e6e4f307]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "cinder-b7d141a8-1bff-487b-945d-6ac525b086a3-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-b7d141a8-1bff-487b-945d-6ac525b086a3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:57 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.314s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:57 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Deleted volume successfully. Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "cinder-quobyte-b7d141a8-1bff-487b-945d-6ac525b086a3" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3670be2e-6eb8-479d-b801-53542edef354 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-568dfbe4-f75b-42f9-b4f5-ab154a8288f7-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:57 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad Aug 01 15:16:57 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-quobyte-b7d141a8-1bff-487b-945d-6ac525b086a3" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[697201dc-3aee-4e50-a352-fe27f9504909]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:58 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3 Aug 01 15:16:58 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:58 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad" returned: 0 in 0.486s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c68781-37a2-496f-b770-fb7a4359c649]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:58 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3" returned: 0 in 0.438s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:58 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 Aug 01 15:16:58 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:58 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3 Aug 01 15:16:58 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-12c44000-d2cd-4d41-9ea8-b005ee67fe77 req-41e3daff-ac9f-4b97-ad5e-647e0e2d5247 tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:58 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b7d141a8-1bff-487b-945d-6ac525b086a3" returned: 0 in 0.252s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:58 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-quobyte-b7d141a8-1bff-487b-945d-6ac525b086a3" released by "delete_volume" :: held 0.734s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8" returned: 0 in 0.394s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:58 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad Aug 01 15:16:58 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Created reservations ['740cf763-f087-4063-857c-1c38c1abc02f', 'ed2c790a-c98c-4c35-95dc-c031acb91048', 'befa62f1-4e0c-42d4-bc05-8155edb53cd1', 'c7c8b07c-8977-4047-a46c-28e6b290e320'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:58 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:16:58 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "cinder-9381432f-a81d-4702-b14e-74b1053d1cee-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-9381432f-a81d-4702-b14e-74b1053d1cee-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:59 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "cinder-quobyte-9381432f-a81d-4702-b14e-74b1053d1cee" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.279s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:16:59 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Deleted volume successfully. Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad" returned: 0 in 0.436s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-quobyte-9381432f-a81d-4702-b14e-74b1053d1cee" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:59 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad Aug 01 15:16:59 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd31c0ef-858c-4969-bf08-0e8f9d01e4c0]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6811061-af69-4c70-8bb2-2f2d4a7a0e07 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-b7d141a8-1bff-487b-945d-6ac525b086a3-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:59 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee Aug 01 15:16:59 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:59 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8.09f2c9b5-0cd2-4cb2-ba59-9209b60147ad" returned: 0 in 0.255s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-09f2c9b5-0cd2-4cb2-ba59-9209b60147ad" released by "_delete_snapshot" :: held 1.722s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.878s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-12c44000-d2cd-4d41-9ea8-b005ee67fe77 req-41e3daff-ac9f-4b97-ad5e-647e0e2d5247 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.908s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-12c44000-d2cd-4d41-9ea8-b005ee67fe77 req-41e3daff-ac9f-4b97-ad5e-647e0e2d5247 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b152f0-756c-4401-a017-807bffc867ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d283609b-fc90-4cad-a130-6222f8405707', 'volume_size': 1, 'source_volid': '77e1b21d-440b-4ab9-b936-ccb597b70fc8', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11c6bf6-2381-4a90-9d19-b67d432a322d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:16:59 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Volume volume-d283609b-fc90-4cad-a130-6222f8405707 (d283609b-fc90-4cad-a130-6222f8405707): created successfully Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11c6bf6-2381-4a90-9d19-b67d432a322d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (f811ee26-5ce1-4de5-a3fa-6a01315bc216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-12c44000-d2cd-4d41-9ea8-b005ee67fe77 req-41e3daff-ac9f-4b97-ad5e-647e0e2d5247 tempest-TestServerVolumeAttachmentScenario-111086386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-1945757d-c966-4f03-9a91-2ffdd8603a9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dd61803-72e7-4de5-9e5e-1df48c4e4c16', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:16:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8956a275-fa08-4284-8f43-7605a4eb1708 tempest-VolumeDependencyTests-1300175653 None] Created volume successfully. Aug 01 15:16:59 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee" returned: 0 in 0.419s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:16:59 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee Aug 01 15:16:59 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:16:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-12c44000-d2cd-4d41-9ea8-b005ee67fe77 req-41e3daff-ac9f-4b97-ad5e-647e0e2d5247 tempest-TestServerVolumeAttachmentScenario-111086386 None] attachment_update completed successfully. Aug 01 15:16:59 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9381432f-a81d-4702-b14e-74b1053d1cee" returned: 0 in 0.288s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-quobyte-9381432f-a81d-4702-b14e-74b1053d1cee" released by "delete_volume" :: held 0.753s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Created reservations ['64aa2f63-600d-43a0-b5bd-b9522fa828eb', 'cd7a99c2-fdc9-42aa-afc4-e32032f7510a', '320bdcfb-f16c-43d0-befc-0d6404b6fe14', 'f2f85bd2-777f-4dfb-93e6-1b14c93c3a97'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-71999240-b0c0-4ab2-a4c0-55ea665c3b7e-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-71999240-b0c0-4ab2-a4c0-55ea665c3b7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-ea82d48d-f56a-42c5-aa62-4beef1381d89" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-ea82d48d-f56a-42c5-aa62-4beef1381d89" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-71999240-b0c0-4ab2-a4c0-55ea665c3b7e" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:16:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-71999240-b0c0-4ab2-a4c0-55ea665c3b7e" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Deleting offline snapshot 71999240-b0c0-4ab2-a4c0-55ea665c3b7e of volume ea82d48d-f56a-42c5-aa62-4beef1381d89 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:17:00 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:00 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] snapshot_file for this snap is: volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9bcefd-a7bb-48ce-88c0-013762d4da1d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:00 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e Aug 01 15:17:00 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:00 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.381s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Deleted volume successfully. Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d30cc91d-47ce-4d57-aa1f-a84d509be713 tempest-CreateVolumesFromImageTest-1239985659 None] Lock "cinder-9381432f-a81d-4702-b14e-74b1053d1cee-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:00 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e" returned: 0 in 0.491s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea82d48d-f56a-42c5-aa62-4beef1381d89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a513e-edd8-4933-99ef-831e907070e0]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:00 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 Aug 01 15:17:00 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:01 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89" returned: 0 in 0.564s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:01 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e Aug 01 15:17:01 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:01 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e" returned: 0 in 0.416s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:01 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e Aug 01 15:17:01 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:01 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89.71999240-b0c0-4ab2-a4c0-55ea665c3b7e" returned: 0 in 0.297s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-71999240-b0c0-4ab2-a4c0-55ea665c3b7e" released by "_delete_snapshot" :: held 1.895s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-ea82d48d-f56a-42c5-aa62-4beef1381d89" released by "delete_snapshot" :: held 1.948s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:02 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Created reservations ['60f8ad20-a6d7-4eeb-bbc5-ec07dfd6c2cd', 'b9f190ed-ba0c-4801-a55c-009707255911', '825cf16c-d2a9-409e-8ac8-a4b6008ba642', 'e4890299-3525-4ca8-8fc0-7ed73f393f64'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Delete snapshot completed successfully. Aug 01 15:17:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-904ccac2-7813-4ae0-a458-a6c95f5d9ee6 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-71999240-b0c0-4ab2-a4c0-55ea665c3b7e-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-1df85182-f2ce-4150-b98f-ad8ac665a0e7 req-7c8d7e92-e291-4385-a5c6-e2de2faddd72 tempest-TestServerVolumeAttachmentScenario-111086386 None] Terminate volume connection completed successfully. Aug 01 15:17:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-1df85182-f2ce-4150-b98f-ad8ac665a0e7 req-7c8d7e92-e291-4385-a5c6-e2de2faddd72 tempest-TestServerVolumeAttachmentScenario-111086386 None] Deleting attachment 3dd61803-72e7-4de5-9e5e-1df48c4e4c16. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-af7b8777-74e9-441c-951a-1bf195d55551-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-af7b8777-74e9-441c-951a-1bf195d55551-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-d91948e5-819b-4d3f-854f-b4f054072969" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d91948e5-819b-4d3f-854f-b4f054072969" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-af7b8777-74e9-441c-951a-1bf195d55551" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-af7b8777-74e9-441c-951a-1bf195d55551" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Deleting offline snapshot af7b8777-74e9-441c-951a-1bf195d55551 of volume d91948e5-819b-4d3f-854f-b4f054072969 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] snapshot_file for this snap is: volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d2a2e1-a78c-496c-9662-37dfbd14ea0c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:03 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 Aug 01 15:17:03 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:03 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551" returned: 0 in 0.568s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91948e5-819b-4d3f-854f-b4f054072969(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc8f37a-a57f-4b0b-a907-fd62f82bfd9d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:04 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 Aug 01 15:17:04 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-fb0afdcc-c570-4644-b9e3-a57a0f84be49 req-d2500705-8a02-4306-875e-b7c4d815376f tempest-TestServerVolumeAttachmentScenario-111086386 None] Terminate volume connection completed successfully. Aug 01 15:17:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-fb0afdcc-c570-4644-b9e3-a57a0f84be49 req-d2500705-8a02-4306-875e-b7c4d815376f tempest-TestServerVolumeAttachmentScenario-111086386 None] Deleting attachment 11ab8e80-b56a-4ba9-b6e7-0b72c37b2f5a. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:17:04 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969" returned: 0 in 0.637s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:04 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 Aug 01 15:17:04 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:05 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551" returned: 0 in 0.505s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:05 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551 Aug 01 15:17:05 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:05 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969.af7b8777-74e9-441c-951a-1bf195d55551" returned: 0 in 0.309s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-af7b8777-74e9-441c-951a-1bf195d55551" released by "_delete_snapshot" :: held 2.164s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d91948e5-819b-4d3f-854f-b4f054072969" released by "delete_snapshot" :: held 2.206s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:05 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Created reservations ['30b09c1c-6464-4dd6-a2be-7197c285db80', 'e6534cc1-63e9-4190-97a6-7506e1df5c72', '22c5e903-af88-4dde-93f5-b0075538a77e', '768a6e56-85d5-4dd3-95cf-f03a93567c70'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:05 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Delete snapshot completed successfully. Aug 01 15:17:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c55c1b54-1056-4492-8591-795458aa814d tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-af7b8777-74e9-441c-951a-1bf195d55551-delete_snapshot" released by "delete_snapshot" :: held 2.411s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-77e1b21d-440b-4ab9-b936-ccb597b70fc8-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-77e1b21d-440b-4ab9-b936-ccb597b70fc8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-77e1b21d-440b-4ab9-b936-ccb597b70fc8" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-77e1b21d-440b-4ab9-b936-ccb597b70fc8" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd0bfef-d1ba-4e2f-a03f-f4290dabf796]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:17:06 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 Aug 01 15:17:06 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Flow 'volume_create_manager' (1be1d3c9-0b88-41d4-ad03-7b1fcf782f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59038af5-ef53-4f8a-8eca-a5284f51780b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59038af5-ef53-4f8a-8eca-a5284f51780b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2befaaec-b0b1-4c0d-bafc-e938f0b4755a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dad6ad14f4c4afe9f01d86f7e89a88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:07Z,use_quota=True,user_id='b719d3917b604f5ab42b6e74f12d04b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ea916d-76fd-40b7-a377-d27572c7f5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ea916d-76fd-40b7-a377-d27572c7f5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98492bb8-99ef-4f65-916e-93b2e32231de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:06 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:17:07 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8" returned: 0 in 0.467s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:07 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8 Aug 01 15:17:07 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98492bb8-99ef-4f65-916e-93b2e32231de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2befaaec-b0b1-4c0d-bafc-e938f0b4755a', 'volume_name': 'volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a', 'volume_size': 1, 'image_id': 'b4293353-c7ae-404f-aec2-fcd85b9172f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4293353-c7ae-404f-aec2-fcd85b9172f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a041103a19485706462d33ca8395b34', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dad6ad14f4c4afe9f01d86f7e89a88f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '973e942ff7a580acec0c7d06c3d8edb6468520fd047af48b1a3ab1bc0547988c740cc0dc47f924c725456d7adcd5f8bcb274ad9102f79573cf964cefacf7da4d', 'id': 'b4293353-c7ae-404f-aec2-fcd85b9172f8', 'created_at': datetime.datetime(2026, 8, 1, 13, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4293353-c7ae-404f-aec2-fcd85b9172f8/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95502007-2e1a-42af-9017-a997f22eedd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95502007-2e1a-42af-9017-a997f22eedd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca4061e-4385-4154-b90c-c72dc54e92ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:07 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Volume 2befaaec-b0b1-4c0d-bafc-e938f0b4755a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a', 'volume_size': 1, 'image_id': 'b4293353-c7ae-404f-aec2-fcd85b9172f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4293353-c7ae-404f-aec2-fcd85b9172f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a041103a19485706462d33ca8395b34', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dad6ad14f4c4afe9f01d86f7e89a88f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '973e942ff7a580acec0c7d06c3d8edb6468520fd047af48b1a3ab1bc0547988c740cc0dc47f924c725456d7adcd5f8bcb274ad9102f79573cf964cefacf7da4d', 'id': 'b4293353-c7ae-404f-aec2-fcd85b9172f8', 'created_at': datetime.datetime(2026, 8, 1, 13, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4293353-c7ae-404f-aec2-fcd85b9172f8/file', 'properties': {}}, 'image_service': } Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Trying to clone 2befaaec-b0b1-4c0d-bafc-e938f0b4755a from image b4293353-c7ae-404f-aec2-fcd85b9172f8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4293353-c7ae-404f-aec2-fcd85b9172f8', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:17:07 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Image download 0.00 MB at 0.00 MB/s Aug 01 15:17:07 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77e1b21d-440b-4ab9-b936-ccb597b70fc8" returned: 0 in 0.278s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9f1a16-13a5-4afd-b832-3733de02194c]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-77e1b21d-440b-4ab9-b936-ccb597b70fc8" released by "delete_volume" :: held 0.858s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Created reservations ['1634bc78-5d4b-4f51-a658-8f358eed4a66', '32c310ff-a666-4095-9ba9-38589cac8c5c', 'd94cd7ab-e6ae-4dcd-872b-b00d03f54a96', 'aba34de4-16b9-4d36-9eb0-226424ef012e'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:07 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD Aug 01 15:17:07 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-ea82d48d-f56a-42c5-aa62-4beef1381d89-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:07 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-ea82d48d-f56a-42c5-aa62-4beef1381d89-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:07 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-ea82d48d-f56a-42c5-aa62-4beef1381d89" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-ea82d48d-f56a-42c5-aa62-4beef1381d89" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd83788e-b5fb-4437-b96a-08072f3ca56e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:07 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:07 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 Aug 01 15:17:07 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:07 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.370s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:07 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Deleted volume successfully. Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f1b42c70-ddd0-49d9-a341-09bc18db6797 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-77e1b21d-440b-4ab9-b936-ccb597b70fc8-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:08 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD Aug 01 15:17:08 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:08 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89" returned: 0 in 0.480s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:08 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Temporary image b4293353-c7ae-404f-aec2-fcd85b9172f8 is fetched for user b719d3917b604f5ab42b6e74f12d04b5. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:17:08 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89 Aug 01 15:17:08 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc50b03-2bde-4cf8-acf1-a968a57b25a6]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:08 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD Aug 01 15:17:08 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:08 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ea82d48d-f56a-42c5-aa62-4beef1381d89" returned: 0 in 0.265s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-ea82d48d-f56a-42c5-aa62-4beef1381d89" released by "delete_volume" :: held 0.825s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Created reservations ['45a0721a-8c37-4d14-906d-7a2eae6f3738', '21f7cfe9-bf4a-4a94-b7d0-3974709afb31', 'b8b92ace-840c-4a69-aa03-4b303391509e', 'd3dc1044-1417-40da-983d-291afd756f1a'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:08 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:08 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:08 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-d91948e5-819b-4d3f-854f-b4f054072969-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:08 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD Aug 01 15:17:08 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-d91948e5-819b-4d3f-854f-b4f054072969-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-d91948e5-819b-4d3f-854f-b4f054072969" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d91948e5-819b-4d3f-854f-b4f054072969" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:08 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.293s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Deleted volume successfully. Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2847c36b-6627-4f2a-ad36-6b7676f2d7dc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7d1c5b25-cce2-4e7e-b626-19ff37c0e147 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-ea82d48d-f56a-42c5-aa62-4beef1381d89-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:09 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2befaaec-b0b1-4c0d-bafc-e938f0b4755a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dad6ad14f4c4afe9f01d86f7e89a88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:07Z,use_quota=True,user_id='b719d3917b604f5ab42b6e74f12d04b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Creating volume 2befaaec-b0b1-4c0d-bafc-e938f0b4755a {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:17:09 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:09 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 Aug 01 15:17:09 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:09 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a 1073741824 Aug 01 15:17:09 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:09 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969" returned: 0 in 0.403s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:09 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969 Aug 01 15:17:09 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:09 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a 1073741824" returned: 0 in 0.528s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:09 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a Aug 01 15:17:09 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:09 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d91948e5-819b-4d3f-854f-b4f054072969" returned: 0 in 0.313s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d91948e5-819b-4d3f-854f-b4f054072969" released by "delete_volume" :: held 0.795s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Created reservations ['176ec3ad-7fbb-4ce8-bd1f-b3d2eac06f49', '8e80fe13-fcce-485d-9a1a-15ababb1288f', '32aa04c3-30e5-4328-9421-ee040015d366', '857beb58-3ed7-48b4-997f-ef09e0be36b2'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:09 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:09 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:09 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a" returned: 0 in 0.288s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:17:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Attempting download of b4293353-c7ae-404f-aec2-fcd85b9172f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4293353-c7ae-404f-aec2-fcd85b9172f8', 'metadata': {}}])) to volume 2befaaec-b0b1-4c0d-bafc-e938f0b4755a. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-d283609b-fc90-4cad-a130-6222f8405707-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc5ece4-34d9-47be-a993-cb1e77612538]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4293353-c7ae-404f-aec2-fcd85b9172f8__119atfg {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-d283609b-fc90-4cad-a130-6222f8405707-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-d283609b-fc90-4cad-a130-6222f8405707" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d283609b-fc90-4cad-a130-6222f8405707" acquired by "delete_volume" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:10 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.333s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Deleted volume successfully. Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0605054b-d99b-46f3-b83e-3132339969d8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:10 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4293353-c7ae-404f-aec2-fcd85b9172f8__119atfg Aug 01 15:17:10 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-43ae917b-d3fd-4deb-bfdc-432c2f7934a4 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-d91948e5-819b-4d3f-854f-b4f054072969-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "cinder-1945757d-c966-4f03-9a91-2ffdd8603a9a-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "cinder-1945757d-c966-4f03-9a91-2ffdd8603a9a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:10 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707 Aug 01 15:17:10 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "cinder-quobyte-1945757d-c966-4f03-9a91-2ffdd8603a9a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "cinder-quobyte-1945757d-c966-4f03-9a91-2ffdd8603a9a" acquired by "delete_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e65968-88d9-44ad-acca-2c8503c62a63]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:10 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4293353-c7ae-404f-aec2-fcd85b9172f8__119atfg" returned: 0 in 0.485s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4293353-c7ae-404f-aec2-fcd85b9172f8__119atfg {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:10 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a Aug 01 15:17:10 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:10 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:10 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4293353-c7ae-404f-aec2-fcd85b9172f8__119atfg Aug 01 15:17:10 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707" returned: 0 in 0.445s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:10 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707 Aug 01 15:17:10 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:10 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a" returned: 0 in 0.399s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:10 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:10 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4293353-c7ae-404f-aec2-fcd85b9172f8__119atfg" returned: 1 in 0.360s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:10 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4293353-c7ae-404f-aec2-fcd85b9172f8__119atfg' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff34a2f-83eb-4814-8fdf-a62a6d2416fb]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:10 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d283609b-fc90-4cad-a130-6222f8405707" returned: 0 in 0.276s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d283609b-fc90-4cad-a130-6222f8405707" released by "delete_volume" :: held 0.780s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Created reservations ['864e120d-1d4e-42d1-bd9f-38248533b16b', 'f84e815c-a9e4-4a28-accd-c26a416de703', 'd346f40b-e2db-4cf9-8b8e-180cfa5ca6ef', '918fcc80-72af-499f-9a1f-6562cc1ed4e0'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:11 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD Aug 01 15:17:11 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:11 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:11 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:11 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1945757d-c966-4f03-9a91-2ffdd8603a9a" returned: 0 in 0.283s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "cinder-quobyte-1945757d-c966-4f03-9a91-2ffdd8603a9a" released by "delete_volume" :: held 0.742s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Created reservations ['e4686ed3-3d99-4e62-87de-5cd44eace6c5', '4f37f22f-7893-4557-8eb2-de08357afba3', 'd4b38236-747b-4e73-9541-13fbc6f6ff99', '0e745710-6a9a-49df-b443-a7979f67f53e'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:11 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:11 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.325s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:11 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Deleted volume successfully. Aug 01 15:17:11 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD Aug 01 15:17:11 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:11 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:11 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f194534c-5a6d-42d5-a63f-68e741c20bfc tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-d283609b-fc90-4cad-a130-6222f8405707-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "cinder-131016be-ff98-488a-8a9a-2391512e9f02-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "cinder-131016be-ff98-488a-8a9a-2391512e9f02-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "cinder-quobyte-131016be-ff98-488a-8a9a-2391512e9f02" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "cinder-quobyte-131016be-ff98-488a-8a9a-2391512e9f02" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d15bae-68db-487b-81e6-35133db2e09a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:11 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.368s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:11 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD" returned: 1 in 0.491s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] b4293353-c7ae-404f-aec2-fcd85b9172f8 was raw, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:11 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Deleted volume successfully. Aug 01 15:17:11 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a Aug 01 15:17:11 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-99e812ad-9e68-4a90-ae77-48e4ba6b58b6 tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "cinder-1945757d-c966-4f03-9a91-2ffdd8603a9a-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:11 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02 Aug 01 15:17:11 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (9c678601-b28a-4430-ac89-d8dbf2cae823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae496cc-2404-45ff-8075-d326c4a33c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae496cc-2404-45ff-8075-d326c4a33c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1524497934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447e585d-6418-4f65-a229-1aa4d3072e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:12Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da83ae36-e8c5-40b0-b17d-b0fe4fe622b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da83ae36-e8c5-40b0-b17d-b0fe4fe622b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bc358f-9e29-4b9b-8f0f-7a9eddcad3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bc358f-9e29-4b9b-8f0f-7a9eddcad3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '447e585d-6418-4f65-a229-1aa4d3072e80', 'volume_name': 'volume-447e585d-6418-4f65-a229-1aa4d3072e80', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6503801-94a9-4f30-8110-2882c2620c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6503801-94a9-4f30-8110-2882c2620c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5547caa-6b6a-4347-a59a-a9acbdaebee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:11 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Volume 447e585d-6418-4f65-a229-1aa4d3072e80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-447e585d-6418-4f65-a229-1aa4d3072e80', 'volume_size': 1} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1524497934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447e585d-6418-4f65-a229-1aa4d3072e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:12Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Creating volume 447e585d-6418-4f65-a229-1aa4d3072e80 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:17:11 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:17:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:12 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 1073741824 Aug 01 15:17:12 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:12 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02" returned: 0 in 0.428s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:12 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02 Aug 01 15:17:12 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:12 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a" returned: 0 in 0.526s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4293353-c7ae-404f-aec2-fcd85b9172f8_s_5myckhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:17:12 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Converted 0.00 MB image at 0.00 MB/s Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:12 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a 1G Aug 01 15:17:12 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:12 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:12 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 1073741824" returned: 0 in 0.479s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-131016be-ff98-488a-8a9a-2391512e9f02" returned: 0 in 0.268s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "cinder-quobyte-131016be-ff98-488a-8a9a-2391512e9f02" released by "delete_volume" :: held 0.759s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:12 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 Aug 01 15:17:12 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Created reservations ['beede7d3-c229-4a2b-8ffd-b4985e13d629', '0eafc412-b8f6-4511-86ef-62d725b1982d', '713346af-8b27-4967-b583-3044af5a65ac', '7c2d1dc4-6439-41db-890c-7154912ea836'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:12 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:12 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:12 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a 1G" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Downloaded image b4293353-c7ae-404f-aec2-fcd85b9172f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/b4293353-c7ae-404f-aec2-fcd85b9172f8', 'metadata': {}}])) to volume 2befaaec-b0b1-4c0d-bafc-e938f0b4755a successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Temporary image b4293353-c7ae-404f-aec2-fcd85b9172f8 for user b719d3917b604f5ab42b6e74f12d04b5 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Marking volume 2befaaec-b0b1-4c0d-bafc-e938f0b4755a as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Copying metadata from image b4293353-c7ae-404f-aec2-fcd85b9172f8 to 2befaaec-b0b1-4c0d-bafc-e938f0b4755a. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Creating volume glance metadata for volume 2befaaec-b0b1-4c0d-bafc-e938f0b4755a backed by image b4293353-c7ae-404f-aec2-fcd85b9172f8 with: {'image_id': 'b4293353-c7ae-404f-aec2-fcd85b9172f8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2a041103a19485706462d33ca8395b34', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:17:12 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca4061e-4385-4154-b90c-c72dc54e92ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a', 'volume_size': 1, 'image_id': 'b4293353-c7ae-404f-aec2-fcd85b9172f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4293353-c7ae-404f-aec2-fcd85b9172f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a041103a19485706462d33ca8395b34', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dad6ad14f4c4afe9f01d86f7e89a88f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '973e942ff7a580acec0c7d06c3d8edb6468520fd047af48b1a3ab1bc0547988c740cc0dc47f924c725456d7adcd5f8bcb274ad9102f79573cf964cefacf7da4d', 'id': 'b4293353-c7ae-404f-aec2-fcd85b9172f8', 'created_at': datetime.datetime(2026, 8, 1, 13, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 17, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4293353-c7ae-404f-aec2-fcd85b9172f8/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3163f377-9c54-4499-bd5f-de6ea45f7466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80" returned: 0 in 0.346s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5547caa-6b6a-4347-a59a-a9acbdaebee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-447e585d-6418-4f65-a229-1aa4d3072e80', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2a16a0-5564-48c1-b0e2-eea71ab42e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:12 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Volume volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a (2befaaec-b0b1-4c0d-bafc-e938f0b4755a): created successfully Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3163f377-9c54-4499-bd5f-de6ea45f7466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Flow 'volume_create_manager' (1be1d3c9-0b88-41d4-ad03-7b1fcf782f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:12 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Volume volume-447e585d-6418-4f65-a229-1aa4d3072e80 (447e585d-6418-4f65-a229-1aa4d3072e80): created successfully Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2a16a0-5564-48c1-b0e2-eea71ab42e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (9c678601-b28a-4430-ac89-d8dbf2cae823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:12 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-01f04898-e506-46dd-85fb-da7beb89a451 tempest-VolumeImageDependencyTests-883274313 None] Created volume successfully. Aug 01 15:17:12 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4b796aba-1dd4-472d-a6aa-83df1105a9e8 tempest-VolumeDependencyTests-1300175653 None] Created volume successfully. Aug 01 15:17:13 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.351s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:13 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Deleted volume successfully. Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-704113ff-b62c-4e23-b9e3-937e8185445d tempest-TestServerVolumeAttachmentScenario-111086386 None] Lock "cinder-131016be-ff98-488a-8a9a-2391512e9f02-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-2befaaec-b0b1-4c0d-bafc-e938f0b4755a-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-2befaaec-b0b1-4c0d-bafc-e938f0b4755a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-quobyte-2befaaec-b0b1-4c0d-bafc-e938f0b4755a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-2befaaec-b0b1-4c0d-bafc-e938f0b4755a" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af62fb0-d118-44f4-a507-dfaa2b88aa57]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:13 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a Aug 01 15:17:13 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:13 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a" returned: 0 in 0.397s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:13 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a Aug 01 15:17:13 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:13 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2befaaec-b0b1-4c0d-bafc-e938f0b4755a" returned: 0 in 0.259s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-2befaaec-b0b1-4c0d-bafc-e938f0b4755a" released by "delete_volume" :: held 0.701s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Created reservations ['64652ca8-c946-4fd9-a29e-fc312a670546', '5a19f930-0718-44a3-a711-77586a41da9d', '1509fb4a-d7f0-4f58-ba45-16aa58625cf9', 'b3b6d376-e9ea-482e-b4bd-59b56f046e9a'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:14 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:14 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] Creating offline snapshot fe06d261-b981-4c51-97b1-80549b24ff3f of volume 447e585d-6418-4f65-a229-1aa4d3072e80 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ed149e-c8c2-46e2-9b29-c76a8e7e6384]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:14 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 Aug 01 15:17:14 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:14 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.325s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:14 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Deleted volume successfully. Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dd1640bb-7b03-4511-981e-345d9dce7659 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-2befaaec-b0b1-4c0d-bafc-e938f0b4755a-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:14 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80" returned: 0 in 0.459s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:14 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f 1G Aug 01 15:17:14 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:15 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f 1G" returned: 0 in 0.488s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-447e585d-6418-4f65-a229-1aa4d3072e80 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:15 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-447e585d-6418-4f65-a229-1aa4d3072e80 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f Aug 01 15:17:15 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:15 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-447e585d-6418-4f65-a229-1aa4d3072e80 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f" returned: 0 in 0.409s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:15 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f is being set with open permissions: ugo+rw Aug 01 15:17:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:15 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f Aug 01 15:17:15 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:15 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f" returned: 0 in 0.354s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:16 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.info Aug 01 15:17:16 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:16 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.info" returned: 0 in 0.294s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:16 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.info is being set with open permissions: ugo+rw Aug 01 15:17:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:16 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.info Aug 01 15:17:16 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:16 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.info" returned: 0 in 0.309s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:16 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-238f2210-c14c-43c5-b8df-8b68a9161469 tempest-VolumeDependencyTests-1300175653 None] Create snapshot completed successfully Aug 01 15:17:17 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:17:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Flow 'volume_create_manager' (52169222-dd21-42ff-a444-30857a337a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770b6242-5d60-4ff4-b85f-f29a5f151c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770b6242-5d60-4ff4-b85f-f29a5f151c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca30f1c1-d349-49ed-9568-c4ef30bf8479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dad6ad14f4c4afe9f01d86f7e89a88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:18Z,use_quota=True,user_id='b719d3917b604f5ab42b6e74f12d04b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c25c602-e578-41df-bfb5-b94f1ce24620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c25c602-e578-41df-bfb5-b94f1ce24620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a9e1e7-8da0-4f69-956f-e5babc4ec83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:17 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a9e1e7-8da0-4f69-956f-e5babc4ec83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca30f1c1-d349-49ed-9568-c4ef30bf8479', 'volume_name': 'volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479', 'volume_size': 1, 'image_id': '99da7dd4-4437-465b-b8f9-73006da2f999', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99da7dd4-4437-465b-b8f9-73006da2f999', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4bfc394cee06be422c2f8078dd1a44c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dad6ad14f4c4afe9f01d86f7e89a88f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd4568d38915a2f3f5320e87a38486cd1f8ba908ff2745bed6f63988e905ba894f0fa4d529749a1bb6984716f405bc65d6264f8c8be017fe6172b7db6b812e616', 'id': '99da7dd4-4437-465b-b8f9-73006da2f999', 'created_at': datetime.datetime(2026, 8, 1, 13, 17, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99da7dd4-4437-465b-b8f9-73006da2f999/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d212ca-0aab-4be9-a5b6-5a1cde05d01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d212ca-0aab-4be9-a5b6-5a1cde05d01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f227685a-4208-4686-b645-3ed4aa0dce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:18 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Volume ca30f1c1-d349-49ed-9568-c4ef30bf8479: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479', 'volume_size': 1, 'image_id': '99da7dd4-4437-465b-b8f9-73006da2f999', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99da7dd4-4437-465b-b8f9-73006da2f999', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4bfc394cee06be422c2f8078dd1a44c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dad6ad14f4c4afe9f01d86f7e89a88f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd4568d38915a2f3f5320e87a38486cd1f8ba908ff2745bed6f63988e905ba894f0fa4d529749a1bb6984716f405bc65d6264f8c8be017fe6172b7db6b812e616', 'id': '99da7dd4-4437-465b-b8f9-73006da2f999', 'created_at': datetime.datetime(2026, 8, 1, 13, 17, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99da7dd4-4437-465b-b8f9-73006da2f999/file', 'properties': {}}, 'image_service': } Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Trying to clone ca30f1c1-d349-49ed-9568-c4ef30bf8479 from image 99da7dd4-4437-465b-b8f9-73006da2f999 at location (None, [{'url': 'file:///opt/stack/data/glance/images/99da7dd4-4437-465b-b8f9-73006da2f999', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (8c0e8fe2-1bb2-4d79-864b-0137135422d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5456cd5-5cb5-492c-986a-1312650a45eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5456cd5-5cb5-492c-986a-1312650a45eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1985599898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8544d80e-27fe-4294-aef9-404bc5981997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe06d261-b981-4c51-97b1-80549b24ff3f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:18Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0660fb-2fa3-42ef-80ef-1244a4c92092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0660fb-2fa3-42ef-80ef-1244a4c92092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2c06ea-1550-4042-90ba-b75639167d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2c06ea-1550-4042-90ba-b75639167d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8544d80e-27fe-4294-aef9-404bc5981997', 'volume_name': 'volume-8544d80e-27fe-4294-aef9-404bc5981997', 'volume_size': 1, 'snapshot_id': 'fe06d261-b981-4c51-97b1-80549b24ff3f'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c6559f-7dd8-4c9e-8f30-b5222d11e62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c6559f-7dd8-4c9e-8f30-b5222d11e62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33736a1f-6873-44a0-aaea-ba6aed0f5fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:18 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Volume 8544d80e-27fe-4294-aef9-404bc5981997: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8544d80e-27fe-4294-aef9-404bc5981997', 'volume_size': 1, 'snapshot_id': 'fe06d261-b981-4c51-97b1-80549b24ff3f'} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-fe06d261-b981-4c51-97b1-80549b24ff3f-8544d80e-27fe-4294-aef9-404bc5981997" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-fe06d261-b981-4c51-97b1-80549b24ff3f-8544d80e-27fe-4294-aef9-404bc5981997" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Creating volume 8544d80e-27fe-4294-aef9-404bc5981997 from snapshot fe06d261-b981-4c51-97b1-80549b24ff3f {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-8544d80e-27fe-4294-aef9-404bc5981997" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:17:18 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Image download 0.00 MB at 0.00 MB/s Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-8544d80e-27fe-4294-aef9-404bc5981997" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] snapshot: fe06d261-b981-4c51-97b1-80549b24ff3f, volume: 8544d80e-27fe-4294-aef9-404bc5981997, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf090d3a-a7ea-4029-8663-677c90a44c52]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3462304c-c024-498f-840a-31847e4194e3]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:18 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD Aug 01 15:17:18 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:18 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:18 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:18 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f Aug 01 15:17:18 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:18 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:18 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.365s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:18 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f" returned: 0 in 0.482s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-447e585d-6418-4f65-a229-1aa4d3072e80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e999380-42b1-4fdd-8df4-08b34f2b60a4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:19 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD Aug 01 15:17:19 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:19 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 Aug 01 15:17:19 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:19 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Temporary image 99da7dd4-4437-465b-b8f9-73006da2f999 is fetched for user b719d3917b604f5ab42b6e74f12d04b5. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24dc556-1f80-4ba6-8581-e73d2f665fc0]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:19 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80" returned: 0 in 0.398s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:19 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 Aug 01 15:17:19 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:19 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD Aug 01 15:17:19 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:19 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:19 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD Aug 01 15:17:19 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:20 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD" returned: 1 in 0.764s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:24 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997" returned: 0 in 5.188s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:17:24 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Converted 1024.00 MB image at 197.36 MB/s Aug 01 15:17:24 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 is being set with open permissions: ugo+rw Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:24 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 Aug 01 15:17:24 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:24 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997" returned: 0 in 0.265s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-8544d80e-27fe-4294-aef9-404bc5981997" released by "_copy_volume_from_snapshot" :: held 6.456s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-fe06d261-b981-4c51-97b1-80549b24ff3f-8544d80e-27fe-4294-aef9-404bc5981997" released by "_create_volume_from_snapshot" :: held 6.533s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.551s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.402s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca30f1c1-d349-49ed-9568-c4ef30bf8479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dad6ad14f4c4afe9f01d86f7e89a88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:18Z,use_quota=True,user_id='b719d3917b604f5ab42b6e74f12d04b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Creating volume ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:17:24 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:24 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 1073741824 Aug 01 15:17:24 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33736a1f-6873-44a0-aaea-ba6aed0f5fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8544d80e-27fe-4294-aef9-404bc5981997', 'volume_size': 1, 'snapshot_id': 'fe06d261-b981-4c51-97b1-80549b24ff3f'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c2e584-78ff-449e-9446-be6186d1b9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:24 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Volume volume-8544d80e-27fe-4294-aef9-404bc5981997 (8544d80e-27fe-4294-aef9-404bc5981997): created successfully Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c2e584-78ff-449e-9446-be6186d1b9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (8c0e8fe2-1bb2-4d79-864b-0137135422d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:25 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3c55424d-cf25-4023-b6ae-0376cb2294e7 tempest-VolumeDependencyTests-1300175653 None] Created volume successfully. Aug 01 15:17:25 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 1073741824" returned: 0 in 0.469s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:25 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 Aug 01 15:17:25 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:25 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479" returned: 0 in 0.270s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:17:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:25 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Attempting download of 99da7dd4-4437-465b-b8f9-73006da2f999 ((None, [{'url': 'file:///opt/stack/data/glance/images/99da7dd4-4437-465b-b8f9-73006da2f999', 'metadata': {}}])) to volume ca30f1c1-d349-49ed-9568-c4ef30bf8479. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:17:25 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5e98ac-e866-4408-bd80-eed7b3eb0749]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99da7dd4-4437-465b-b8f9-73006da2f999_bcf7sqow {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:25 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99da7dd4-4437-465b-b8f9-73006da2f999_bcf7sqow Aug 01 15:17:25 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:26 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99da7dd4-4437-465b-b8f9-73006da2f999_bcf7sqow" returned: 0 in 0.358s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99da7dd4-4437-465b-b8f9-73006da2f999_bcf7sqow {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] Creating offline snapshot 27af40aa-066b-47ec-a887-4612c744bc32 of volume 8544d80e-27fe-4294-aef9-404bc5981997 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7589fd-5624-4626-9e62-6cebae650849]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:26 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99da7dd4-4437-465b-b8f9-73006da2f999_bcf7sqow Aug 01 15:17:26 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:26 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 Aug 01 15:17:26 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:26 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99da7dd4-4437-465b-b8f9-73006da2f999_bcf7sqow" returned: 1 in 0.353s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99da7dd4-4437-465b-b8f9-73006da2f999_bcf7sqow' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eefe6c-3a07-4dc8-82f9-563baeabd829]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:26 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD Aug 01 15:17:26 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:26 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997" returned: 0 in 0.434s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:26 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 1G Aug 01 15:17:26 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:26 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:27 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD Aug 01 15:17:27 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:27 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 1G" returned: 0 in 0.517s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8544d80e-27fe-4294-aef9-404bc5981997 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:27 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8544d80e-27fe-4294-aef9-404bc5981997 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 Aug 01 15:17:27 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:27 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] 99da7dd4-4437-465b-b8f9-73006da2f999 was raw, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:27 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 Aug 01 15:17:27 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:27 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8544d80e-27fe-4294-aef9-404bc5981997 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32" returned: 0 in 0.346s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:27 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 is being set with open permissions: ugo+rw Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:27 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 Aug 01 15:17:27 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:27 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32" returned: 0 in 0.307s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:27 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479" returned: 0 in 0.590s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_99da7dd4-4437-465b-b8f9-73006da2f999_dec6a_8zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:17:27 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Converted 0.00 MB image at 0.00 MB/s Aug 01 15:17:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:27 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.info Aug 01 15:17:27 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:27 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 1G Aug 01 15:17:27 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:28 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.info" returned: 0 in 0.309s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:28 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.info is being set with open permissions: ugo+rw Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:28 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.info Aug 01 15:17:28 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:28 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 1G" returned: 0 in 0.391s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Downloaded image 99da7dd4-4437-465b-b8f9-73006da2f999 ((None, [{'url': 'file:///opt/stack/data/glance/images/99da7dd4-4437-465b-b8f9-73006da2f999', 'metadata': {}}])) to volume ca30f1c1-d349-49ed-9568-c4ef30bf8479 successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Temporary image 99da7dd4-4437-465b-b8f9-73006da2f999 for user b719d3917b604f5ab42b6e74f12d04b5 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Marking volume ca30f1c1-d349-49ed-9568-c4ef30bf8479 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Copying metadata from image 99da7dd4-4437-465b-b8f9-73006da2f999 to ca30f1c1-d349-49ed-9568-c4ef30bf8479. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Creating volume glance metadata for volume ca30f1c1-d349-49ed-9568-c4ef30bf8479 backed by image 99da7dd4-4437-465b-b8f9-73006da2f999 with: {'image_id': '99da7dd4-4437-465b-b8f9-73006da2f999', 'image_name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'checksum': '4bfc394cee06be422c2f8078dd1a44c0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f227685a-4208-4686-b645-3ed4aa0dce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479', 'volume_size': 1, 'image_id': '99da7dd4-4437-465b-b8f9-73006da2f999', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99da7dd4-4437-465b-b8f9-73006da2f999', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4bfc394cee06be422c2f8078dd1a44c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dad6ad14f4c4afe9f01d86f7e89a88f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd4568d38915a2f3f5320e87a38486cd1f8ba908ff2745bed6f63988e905ba894f0fa4d529749a1bb6984716f405bc65d6264f8c8be017fe6172b7db6b812e616', 'id': '99da7dd4-4437-465b-b8f9-73006da2f999', 'created_at': datetime.datetime(2026, 8, 1, 13, 17, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 17, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99da7dd4-4437-465b-b8f9-73006da2f999/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a824b4-d558-4417-86c1-7786f10c674c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:28 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Volume volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 (ca30f1c1-d349-49ed-9568-c4ef30bf8479): created successfully Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a824b4-d558-4417-86c1-7786f10c674c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Flow 'volume_create_manager' (52169222-dd21-42ff-a444-30857a337a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:28 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6d32250d-7fde-4c90-8ab7-5fdf53db14dc tempest-VolumeImageDependencyTests-883274313 None] Created volume successfully. Aug 01 15:17:28 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.info" returned: 0 in 0.293s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.318s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:28 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cce71f60-c4d8-46fb-90f0-c35e27341b13 tempest-VolumeDependencyTests-1300175653 None] Create snapshot completed successfully Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Flow 'volume_create_manager' (d284059f-7bb4-4e07-b8cc-bcf0a432359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4001fc4d-109a-43ad-959e-6a39096d1f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4001fc4d-109a-43ad-959e-6a39096d1f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503a996b-4150-4714-a42e-689a6f880797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dad6ad14f4c4afe9f01d86f7e89a88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ca30f1c1-d349-49ed-9568-c4ef30bf8479,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:29Z,use_quota=True,user_id='b719d3917b604f5ab42b6e74f12d04b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bfa408-8121-462b-92b1-041022f8d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bfa408-8121-462b-92b1-041022f8d64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2d3e22-815a-493d-b2be-9f463f209c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2d3e22-815a-493d-b2be-9f463f209c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '503a996b-4150-4714-a42e-689a6f880797', 'volume_name': 'volume-503a996b-4150-4714-a42e-689a6f880797', 'volume_size': 1, 'source_volid': 'ca30f1c1-d349-49ed-9568-c4ef30bf8479', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72febab0-f4d6-4bca-ae2c-1827a75f5c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72febab0-f4d6-4bca-ae2c-1827a75f5c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2050dadb-f62d-4ff4-a06d-6f7f9f071325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:29 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Volume 503a996b-4150-4714-a42e-689a6f880797: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-503a996b-4150-4714-a42e-689a6f880797', 'volume_size': 1, 'source_volid': 'ca30f1c1-d349-49ed-9568-c4ef30bf8479', 'source_volstatus': 'available'} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:29 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Cloning volume ca30f1c1-d349-49ed-9568-c4ef30bf8479 to volume 503a996b-4150-4714-a42e-689a6f880797 Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Creating offline snapshot f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 of volume ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c169c646-8859-4dd6-89c3-11b6ac59995f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:29 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 Aug 01 15:17:29 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:29 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (d271ba7f-2da4-4b17-af94-88eb9d6ed41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecde5d0f-7f0c-43fb-90bd-fac36451c2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecde5d0f-7f0c-43fb-90bd-fac36451c2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1904259252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=27af40aa-066b-47ec-a887-4612c744bc32,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:30Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabd5e76-c88b-4a08-88cf-7053897f9520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabd5e76-c88b-4a08-88cf-7053897f9520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23680c2f-2a99-48d0-b68f-c6a9e182fb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23680c2f-2a99-48d0-b68f-c6a9e182fb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c', 'volume_name': 'volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c', 'volume_size': 1, 'snapshot_id': '27af40aa-066b-47ec-a887-4612c744bc32'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4101ed50-7e44-4f7d-8a34-a2d37e5fac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4101ed50-7e44-4f7d-8a34-a2d37e5fac48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfb7013-4957-4120-bf6e-01e972ba2d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:30 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Volume e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c', 'volume_size': 1, 'snapshot_id': '27af40aa-066b-47ec-a887-4612c744bc32'} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:30 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479" returned: 0 in 0.449s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:30 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 1G Aug 01 15:17:30 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:30 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 1G" returned: 0 in 0.482s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:30 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 Aug 01 15:17:30 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:30 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1" returned: 0 in 0.304s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:30 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 is being set with open permissions: ugo+rw Aug 01 15:17:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:30 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 Aug 01 15:17:30 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:31 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1" returned: 0 in 0.240s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:31 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.info Aug 01 15:17:31 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:31 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.info" returned: 0 in 0.267s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:31 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.info is being set with open permissions: ugo+rw Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:31 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.info Aug 01 15:17:31 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:31 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.info" returned: 0 in 0.329s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-quobyte-503a996b-4150-4714-a42e-689a6f880797" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-503a996b-4150-4714-a42e-689a6f880797" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] snapshot: f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1, volume: 503a996b-4150-4714-a42e-689a6f880797, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[751a8faa-de4b-4512-b292-23d701d0fa3c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:31 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 Aug 01 15:17:31 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:32 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1" returned: 0 in 0.364s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:17:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fd8d87-91e0-4309-8e73-209d30017d01]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:32 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 Aug 01 15:17:32 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:32 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479" returned: 0 in 0.411s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:17:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:17:32 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:17:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:32 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797 Aug 01 15:17:32 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:33 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797" returned: 0 in 0.633s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:33 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:17:33 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 01 15:17:33 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797 is being set with open permissions: ugo+rw Aug 01 15:17:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:33 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797 Aug 01 15:17:33 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:33 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797" returned: 0 in 0.288s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-503a996b-4150-4714-a42e-689a6f880797" released by "_copy_volume_from_snapshot" :: held 1.768s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-quobyte-f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Deleting offline snapshot f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 of volume ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:17:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] snapshot_file for this snap is: volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:17:33 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8734650f-43df-4128-b56e-d90b17ccb05f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:33 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 Aug 01 15:17:33 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:34 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1" returned: 0 in 0.504s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:17:34 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba96d05f-5b44-41a5-bf15-c505ab842f03]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:34 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 Aug 01 15:17:34 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:34 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479" returned: 0 in 0.423s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:34 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 Aug 01 15:17:34 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:35 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1" returned: 0 in 0.362s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:35 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1 Aug 01 15:17:35 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:35 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479.f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1" returned: 0 in 0.273s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-f9cad0b8-50a7-44bc-9988-3b97d6aaa2b1" released by "_delete_snapshot" :: held 1.685s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.739s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Marking volume 503a996b-4150-4714-a42e-689a6f880797 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.246s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-27af40aa-066b-47ec-a887-4612c744bc32-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Copying metadata from source volume ca30f1c1-d349-49ed-9568-c4ef30bf8479 to 503a996b-4150-4714-a42e-689a6f880797. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-27af40aa-066b-47ec-a887-4612c744bc32-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Creating volume e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c from snapshot 27af40aa-066b-47ec-a887-4612c744bc32 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] snapshot: 27af40aa-066b-47ec-a887-4612c744bc32, volume: e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2050dadb-f62d-4ff4-a06d-6f7f9f071325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503a996b-4150-4714-a42e-689a6f880797', 'volume_size': 1, 'source_volid': 'ca30f1c1-d349-49ed-9568-c4ef30bf8479', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884ef904-5ef8-49a9-a37d-1d2d22bd72bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e75247-ebb9-4b7d-bb32-e022b928be3b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:35 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Volume volume-503a996b-4150-4714-a42e-689a6f880797 (503a996b-4150-4714-a42e-689a6f880797): created successfully Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884ef904-5ef8-49a9-a37d-1d2d22bd72bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Flow 'volume_create_manager' (d284059f-7bb4-4e07-b8cc-bcf0a432359e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:35 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6dcfaca1-22f6-4964-9fe6-3dd5123380b7 tempest-VolumeImageDependencyTests-883274313 None] Created volume successfully. Aug 01 15:17:35 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 Aug 01 15:17:35 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:35 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32" returned: 0 in 0.445s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8544d80e-27fe-4294-aef9-404bc5981997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[489e3139-9d47-4f9c-80c6-b0ebc89519a2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-ca30f1c1-d349-49ed-9568-c4ef30bf8479-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-ca30f1c1-d349-49ed-9568-c4ef30bf8479-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=141,cinder:INSERT=52,cinder:UPDATE=168,cinder:DELETE=12 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-quobyte-ca30f1c1-d349-49ed-9568-c4ef30bf8479" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-ca30f1c1-d349-49ed-9568-c4ef30bf8479" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:36 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 Aug 01 15:17:36 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5c8720-cc27-4425-960f-8d9f5ef3e122]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:36 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 Aug 01 15:17:36 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:36 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997" returned: 0 in 0.519s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:36 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c Aug 01 15:17:36 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:36 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479" returned: 0 in 0.452s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:36 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479 Aug 01 15:17:36 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:36 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ca30f1c1-d349-49ed-9568-c4ef30bf8479" returned: 0 in 0.314s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-ca30f1c1-d349-49ed-9568-c4ef30bf8479" released by "delete_volume" :: held 0.846s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Created reservations ['2a83f52a-c9e0-4a5c-9aa8-85304a83fe53', 'ca1a213f-8253-49e2-9e61-5aa0bd9e534b', '2923a7f6-9789-411d-83ad-0b30ebc03e35', '882095af-7e5a-41c9-b418-86985569c673'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:37 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" returned: 0 in 0.718s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:17:37 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 01 15:17:37 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c is being set with open permissions: ugo+rw Aug 01 15:17:37 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:37 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:37 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c Aug 01 15:17:37 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:37 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.488s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:37 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Deleted volume successfully. Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-67e6567d-c73f-403b-8ed6-00ccace6fc07 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-ca30f1c1-d349-49ed-9568-c4ef30bf8479-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:37 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" returned: 0 in 0.487s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" released by "_copy_volume_from_snapshot" :: held 2.293s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-27af40aa-066b-47ec-a887-4612c744bc32-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" released by "_create_volume_from_snapshot" :: held 2.374s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.404s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfb7013-4957-4120-bf6e-01e972ba2d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c', 'volume_size': 1, 'snapshot_id': '27af40aa-066b-47ec-a887-4612c744bc32'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb2eb730-c1bc-4143-adbc-948e201428a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:37 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Volume volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c (e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c): created successfully Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb2eb730-c1bc-4143-adbc-948e201428a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (d271ba7f-2da4-4b17-af94-88eb9d6ed41e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:37 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-bbb66c2c-5769-42e1-9cc7-39baf55d1920 tempest-VolumeDependencyTests-1300175653 None] Created volume successfully. Aug 01 15:17:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-fe06d261-b981-4c51-97b1-80549b24ff3f-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-fe06d261-b981-4c51-97b1-80549b24ff3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-447e585d-6418-4f65-a229-1aa4d3072e80" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-447e585d-6418-4f65-a229-1aa4d3072e80" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-fe06d261-b981-4c51-97b1-80549b24ff3f" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-fe06d261-b981-4c51-97b1-80549b24ff3f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Deleting offline snapshot fe06d261-b981-4c51-97b1-80549b24ff3f of volume 447e585d-6418-4f65-a229-1aa4d3072e80 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:17:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] snapshot_file for this snap is: volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:17:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bfbeca-fd56-4879-8999-8470494856a9]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:38 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f Aug 01 15:17:38 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:39 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f" returned: 0 in 0.461s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-447e585d-6418-4f65-a229-1aa4d3072e80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:17:39 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[520ab91e-6b48-41a7-a323-3207061d221b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:39 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 Aug 01 15:17:39 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:39 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80" returned: 0 in 0.603s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:39 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f Aug 01 15:17:39 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:40 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f" returned: 0 in 0.413s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:40 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f Aug 01 15:17:40 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:40 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80.fe06d261-b981-4c51-97b1-80549b24ff3f" returned: 0 in 0.276s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-fe06d261-b981-4c51-97b1-80549b24ff3f" released by "_delete_snapshot" :: held 1.890s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-447e585d-6418-4f65-a229-1aa4d3072e80" released by "delete_snapshot" :: held 1.917s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Created reservations ['88cccfc2-c19d-4cdc-baad-b5c30059e0dc', '17afde0d-0620-4e8d-8266-db2c7b316af5', 'cf383b92-40ff-4705-82ef-78e6a23342f6', '1a5511ec-d466-46de-9289-f043295e8bbe'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Delete snapshot completed successfully. Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cd3e47c8-42c1-4528-935a-4df7ad608898 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-fe06d261-b981-4c51-97b1-80549b24ff3f-delete_snapshot" released by "delete_snapshot" :: held 2.077s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Flow 'volume_create_manager' (481a91d1-84d3-4d2a-b0bf-fc6ca9d930f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5725397-2ab8-443a-8505-9695e83f1a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-27af40aa-066b-47ec-a887-4612c744bc32-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5725397-2ab8-443a-8505-9695e83f1a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4424cf-58b4-45b6-8797-60374d036ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dad6ad14f4c4afe9f01d86f7e89a88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:41Z,use_quota=True,user_id='b719d3917b604f5ab42b6e74f12d04b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5353883e-89bd-4395-a43b-cc510bdbc90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5353883e-89bd-4395-a43b-cc510bdbc90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc6b818-db06-4cbc-a91a-b38cd0fa783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-27af40aa-066b-47ec-a887-4612c744bc32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-8544d80e-27fe-4294-aef9-404bc5981997" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-8544d80e-27fe-4294-aef9-404bc5981997" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-27af40aa-066b-47ec-a887-4612c744bc32" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-27af40aa-066b-47ec-a887-4612c744bc32" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Deleting offline snapshot 27af40aa-066b-47ec-a887-4612c744bc32 of volume 8544d80e-27fe-4294-aef9-404bc5981997 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] snapshot_file for this snap is: volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf105c5a-dc20-4fb0-8bdc-6b05eeaa9f96]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:41 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 Aug 01 15:17:41 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc6b818-db06-4cbc-a91a-b38cd0fa783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e4424cf-58b4-45b6-8797-60374d036ac8', 'volume_name': 'volume-8e4424cf-58b4-45b6-8797-60374d036ac8', 'volume_size': 1, 'image_id': '06919de3-187d-46ba-9925-46b23fc6052a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/06919de3-187d-46ba-9925-46b23fc6052a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1290964735ca958476f9da7489af788b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dad6ad14f4c4afe9f01d86f7e89a88f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ac066bf5290c6aa565a78cdb1a34ff3394404bc5825b5a03308ad363b59faaa8038d1666c652dbe22cde8c3fc0a86ffab6dd18590216eb68dd5ae8049a65a78', 'id': '06919de3-187d-46ba-9925-46b23fc6052a', 'created_at': datetime.datetime(2026, 8, 1, 13, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/06919de3-187d-46ba-9925-46b23fc6052a/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c3d620-97be-4064-b12c-1751bb4b8ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c3d620-97be-4064-b12c-1751bb4b8ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4cf674-8679-49bd-a967-76732bdf2504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:41 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Volume 8e4424cf-58b4-45b6-8797-60374d036ac8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e4424cf-58b4-45b6-8797-60374d036ac8', 'volume_size': 1, 'image_id': '06919de3-187d-46ba-9925-46b23fc6052a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/06919de3-187d-46ba-9925-46b23fc6052a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1290964735ca958476f9da7489af788b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dad6ad14f4c4afe9f01d86f7e89a88f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ac066bf5290c6aa565a78cdb1a34ff3394404bc5825b5a03308ad363b59faaa8038d1666c652dbe22cde8c3fc0a86ffab6dd18590216eb68dd5ae8049a65a78', 'id': '06919de3-187d-46ba-9925-46b23fc6052a', 'created_at': datetime.datetime(2026, 8, 1, 13, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/06919de3-187d-46ba-9925-46b23fc6052a/file', 'properties': {}}, 'image_service': } Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Trying to clone 8e4424cf-58b4-45b6-8797-60374d036ac8 from image 06919de3-187d-46ba-9925-46b23fc6052a at location (None, [{'url': 'file:///opt/stack/data/glance/images/06919de3-187d-46ba-9925-46b23fc6052a', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:17:41 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32" returned: 0 in 0.417s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8544d80e-27fe-4294-aef9-404bc5981997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:17:41 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Image download 0.00 MB at 0.00 MB/s Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d95135-b4bd-48bd-9a20-2bdc059301b1]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e63bbc0-bbef-4fc9-80dc-5507ded4a7a8]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:41 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 Aug 01 15:17:41 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:41 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD Aug 01 15:17:41 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:41 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997" returned: 0 in 0.406s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:41 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:41 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 Aug 01 15:17:41 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:41 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD Aug 01 15:17:41 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:42 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD" returned: 1 in 0.353s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:42 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Temporary image 06919de3-187d-46ba-9925-46b23fc6052a is fetched for user b719d3917b604f5ab42b6e74f12d04b5. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32" returned: 0 in 0.374s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:42 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32 Aug 01 15:17:42 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7388fac-2633-45b5-8b8b-1890051215c3]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:42 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD Aug 01 15:17:42 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:42 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997.27af40aa-066b-47ec-a887-4612c744bc32" returned: 0 in 0.332s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-27af40aa-066b-47ec-a887-4612c744bc32" released by "_delete_snapshot" :: held 1.663s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-8544d80e-27fe-4294-aef9-404bc5981997" released by "delete_snapshot" :: held 1.688s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Created reservations ['08d2f0fe-dea4-4c99-b2cd-3ed3c9d3bfc9', 'e7bf8f20-122e-432e-8aad-4c51c4e06b14', 'cd291de0-adba-48e0-b602-1e8772384c6d', 'f2b1bcbb-7aa0-4198-8cd7-f2162e464c4d'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Delete snapshot completed successfully. Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-873c4edb-1e67-4381-866f-069987551398 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-27af40aa-066b-47ec-a887-4612c744bc32-delete_snapshot" released by "delete_snapshot" :: held 1.862s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:42 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD" returned: 0 in 0.489s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:42 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD Aug 01 15:17:42 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-447e585d-6418-4f65-a229-1aa4d3072e80-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-447e585d-6418-4f65-a229-1aa4d3072e80-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=169,cinder:UPDATE=178,cinder:DELETE=16,cinder:INSERT=59 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-447e585d-6418-4f65-a229-1aa4d3072e80" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-447e585d-6418-4f65-a229-1aa4d3072e80" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:43 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD" returned: 1 in 0.408s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4424cf-58b4-45b6-8797-60374d036ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dad6ad14f4c4afe9f01d86f7e89a88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:41Z,use_quota=True,user_id='b719d3917b604f5ab42b6e74f12d04b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Creating volume 8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:17:43 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc2bdc3-944f-4e0a-90e8-0e23972f9037]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:43 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 1073741824 Aug 01 15:17:43 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:43 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 Aug 01 15:17:43 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:43 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80" returned: 0 in 0.431s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:43 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80 Aug 01 15:17:43 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:43 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 1073741824" returned: 0 in 0.546s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:43 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 Aug 01 15:17:43 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:43 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-447e585d-6418-4f65-a229-1aa4d3072e80" returned: 0 in 0.322s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-447e585d-6418-4f65-a229-1aa4d3072e80" released by "delete_volume" :: held 0.862s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Created reservations ['d20ccef7-9d08-4e49-9fec-4c54ee8cbbb3', 'fadd3ef1-c675-4d44-abc4-519e316aa003', '6f38ca32-c16f-47da-adc0-865fc0dd2c6b', 'ad7cceb5-2fe6-4ad5-8233-cc1dfbdc084a'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:44 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8" returned: 0 in 0.438s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:44 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:44 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-8544d80e-27fe-4294-aef9-404bc5981997-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Attempting download of 06919de3-187d-46ba-9925-46b23fc6052a ((None, [{'url': 'file:///opt/stack/data/glance/images/06919de3-187d-46ba-9925-46b23fc6052a', 'metadata': {}}])) to volume 8e4424cf-58b4-45b6-8797-60374d036ac8. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-8544d80e-27fe-4294-aef9-404bc5981997-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be4cd3e-e824-434c-b22c-b5dffa38da21]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_06919de3-187d-46ba-9925-46b23fc6052a_k6j_y64w {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-8544d80e-27fe-4294-aef9-404bc5981997" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-8544d80e-27fe-4294-aef9-404bc5981997" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d973bed5-c6e6-471d-b06a-aad1f769c614]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:44 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_06919de3-187d-46ba-9925-46b23fc6052a_k6j_y64w Aug 01 15:17:44 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:44 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.464s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:44 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Deleted volume successfully. Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4e69c5fc-729c-48c4-b7ed-d8a90c23409c tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-447e585d-6418-4f65-a229-1aa4d3072e80-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:44 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 Aug 01 15:17:44 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:44 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_06919de3-187d-46ba-9925-46b23fc6052a_k6j_y64w" returned: 0 in 0.498s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_06919de3-187d-46ba-9925-46b23fc6052a_k6j_y64w {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:44 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_06919de3-187d-46ba-9925-46b23fc6052a_k6j_y64w Aug 01 15:17:44 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:45 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997" returned: 0 in 0.541s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:45 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997 Aug 01 15:17:45 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:45 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_06919de3-187d-46ba-9925-46b23fc6052a_k6j_y64w" returned: 1 in 0.396s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_06919de3-187d-46ba-9925-46b23fc6052a_k6j_y64w' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0decdd44-3235-4007-8730-66ac095e0051]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:45 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8544d80e-27fe-4294-aef9-404bc5981997" returned: 0 in 0.273s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:45 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD Aug 01 15:17:45 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-8544d80e-27fe-4294-aef9-404bc5981997" released by "delete_volume" :: held 0.927s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Created reservations ['c5328305-1235-495b-96d1-416f3cd88751', '95361803-859b-4468-a6de-062acf9c2321', '58872427-57bc-4efc-8978-7839a91ea7d4', 'ca22dcbd-a78f-44bd-9312-04d33aa2709f'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:45 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:45 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:45 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:45 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD Aug 01 15:17:45 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:45 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Deleted volume successfully. Aug 01 15:17:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-912db35c-b2ca-4429-81fa-6da14f5e8c92 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-8544d80e-27fe-4294-aef9-404bc5981997-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:46 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD" returned: 1 in 0.391s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] 06919de3-187d-46ba-9925-46b23fc6052a was raw, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:46 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 Aug 01 15:17:46 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:46 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8" returned: 0 in 0.673s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_06919de3-187d-46ba-9925-46b23fc6052a_qv960cl4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:17:46 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Converted 0.00 MB image at 0.00 MB/s Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" acquired by "delete_volume" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:46 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 1G Aug 01 15:17:46 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c072bf-7f87-4e1e-b6f6-650c8fe03a8f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:46 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c Aug 01 15:17:46 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:47 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 1G" returned: 0 in 0.400s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Downloaded image 06919de3-187d-46ba-9925-46b23fc6052a ((None, [{'url': 'file:///opt/stack/data/glance/images/06919de3-187d-46ba-9925-46b23fc6052a', 'metadata': {}}])) to volume 8e4424cf-58b4-45b6-8797-60374d036ac8 successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Temporary image 06919de3-187d-46ba-9925-46b23fc6052a for user b719d3917b604f5ab42b6e74f12d04b5 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Marking volume 8e4424cf-58b4-45b6-8797-60374d036ac8 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Copying metadata from image 06919de3-187d-46ba-9925-46b23fc6052a to 8e4424cf-58b4-45b6-8797-60374d036ac8. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Creating volume glance metadata for volume 8e4424cf-58b4-45b6-8797-60374d036ac8 backed by image 06919de3-187d-46ba-9925-46b23fc6052a with: {'image_id': '06919de3-187d-46ba-9925-46b23fc6052a', 'image_name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'checksum': '1290964735ca958476f9da7489af788b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:17:47 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4cf674-8679-49bd-a967-76732bdf2504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e4424cf-58b4-45b6-8797-60374d036ac8', 'volume_size': 1, 'image_id': '06919de3-187d-46ba-9925-46b23fc6052a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/06919de3-187d-46ba-9925-46b23fc6052a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1290964735ca958476f9da7489af788b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3dad6ad14f4c4afe9f01d86f7e89a88f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ac066bf5290c6aa565a78cdb1a34ff3394404bc5825b5a03308ad363b59faaa8038d1666c652dbe22cde8c3fc0a86ffab6dd18590216eb68dd5ae8049a65a78', 'id': '06919de3-187d-46ba-9925-46b23fc6052a', 'created_at': datetime.datetime(2026, 8, 1, 13, 17, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/06919de3-187d-46ba-9925-46b23fc6052a/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a68364-8704-4ee0-83ce-0e25649e25f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" returned: 0 in 0.461s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Volume volume-8e4424cf-58b4-45b6-8797-60374d036ac8 (8e4424cf-58b4-45b6-8797-60374d036ac8): created successfully Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a68364-8704-4ee0-83ce-0e25649e25f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:47 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c Aug 01 15:17:47 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Flow 'volume_create_manager' (481a91d1-84d3-4d2a-b0bf-fc6ca9d930f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d8de44e9-aeca-4e62-b7a3-6280ed70cc88 tempest-VolumeImageDependencyTests-883274313 None] Created volume successfully. Aug 01 15:17:47 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" returned: 0 in 0.281s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c" released by "delete_volume" :: held 0.793s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Created reservations ['5a4683d8-ac74-4317-9c0f-5f2e4eefb041', '53517b54-5e0e-4f91-bbe0-81f60bf470f4', '6d92d189-5732-4019-b23f-f17486cd067e', '94b91fae-3448-4603-bf4e-6c877b71e454'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:47 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:17:47 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:47 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.296s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:47 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:17:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Deleted volume successfully. Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b0a5498c-af72-46b4-bc2e-2fb05fad0f35 tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-e0a95f14-fa0a-47d6-ab0c-ee9c1049ab2c-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (540489cf-dd58-4706-8a08-1b709295efce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c1cb4e-cd72-4879-8feb-5b131f7d3b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c1cb4e-cd72-4879-8feb-5b131f7d3b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1511958619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfae74a-9792-42b4-89c8-a4f52772e39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:48Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f11d4bc-6f64-498c-ae2d-0b4b751024dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f11d4bc-6f64-498c-ae2d-0b4b751024dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648b719b-81f0-4034-9c40-6e75b01080a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648b719b-81f0-4034-9c40-6e75b01080a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abfae74a-9792-42b4-89c8-a4f52772e39c', 'volume_name': 'volume-abfae74a-9792-42b4-89c8-a4f52772e39c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3541e70b-983d-412d-af6a-c7a140664f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3541e70b-983d-412d-af6a-c7a140664f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17943be-d183-4a1d-9d5e-dd9e1f590e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:48 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Volume abfae74a-9792-42b4-89c8-a4f52772e39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abfae74a-9792-42b4-89c8-a4f52772e39c', 'volume_size': 1} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1511958619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfae74a-9792-42b4-89c8-a4f52772e39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:48Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Creating volume abfae74a-9792-42b4-89c8-a4f52772e39c {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:17:48 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:48 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c 1073741824 Aug 01 15:17:48 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:48 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c 1073741824" returned: 0 in 0.512s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:48 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c Aug 01 15:17:48 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:49 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c" returned: 0 in 0.312s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.636s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17943be-d183-4a1d-9d5e-dd9e1f590e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abfae74a-9792-42b4-89c8-a4f52772e39c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c477625b-0695-4a76-a639-9efacedb8dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] Creating offline snapshot 1fefb98e-c342-4ad6-a80a-8c8340d846cd of volume 8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:17:49 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Volume volume-abfae74a-9792-42b4-89c8-a4f52772e39c (abfae74a-9792-42b4-89c8-a4f52772e39c): created successfully Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c477625b-0695-4a76-a639-9efacedb8dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (540489cf-dd58-4706-8a08-1b709295efce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4d46a4-4e7e-4e71-8ca8-dbda3a56a923]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:49 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0fc3a82e-128d-4aa3-99d0-3686d05123bb tempest-VolumeDependencyTests-1300175653 None] Created volume successfully. Aug 01 15:17:49 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 Aug 01 15:17:49 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:49 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8" returned: 0 in 0.397s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:49 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd 1G Aug 01 15:17:49 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:50 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd 1G" returned: 0 in 0.434s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e4424cf-58b4-45b6-8797-60374d036ac8 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:50 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e4424cf-58b4-45b6-8797-60374d036ac8 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd Aug 01 15:17:50 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:50 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e4424cf-58b4-45b6-8797-60374d036ac8 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd" returned: 0 in 0.328s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:50 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd is being set with open permissions: ugo+rw Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:50 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd Aug 01 15:17:50 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Flow 'volume_create_manager' (b99b88b4-f093-4a43-9c80-240e7a983852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cdf19eb-8ba3-4c31-9aac-07d0ed5f616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:50 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd" returned: 0 in 0.277s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cdf19eb-8ba3-4c31-9aac-07d0ed5f616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-67690889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adbc8d3-971b-4046-8740-4e48ac783189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054628ad77cf4b88a010cb1958fc4a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:51Z,use_quota=True,user_id='515efb5fe5b04ef997d43aa26d5816b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e4a0e3-1b42-413a-8a95-5897982d166c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e4a0e3-1b42-413a-8a95-5897982d166c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9aca1d-bc5e-45c6-b53c-c1d696cd8bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:17:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:50 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.info Aug 01 15:17:50 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:51 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.info" returned: 0 in 0.269s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:51 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.info is being set with open permissions: ugo+rw Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9aca1d-bc5e-45c6-b53c-c1d696cd8bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4adbc8d3-971b-4046-8740-4e48ac783189', 'volume_name': 'volume-4adbc8d3-971b-4046-8740-4e48ac783189', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3331d68c-7af9-4579-9f3e-899057a61207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:51 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.info Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3331d68c-7af9-4579-9f3e-899057a61207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:51 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0be05d7-0495-4055-a2c8-1ad472e04c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:51 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Volume 4adbc8d3-971b-4046-8740-4e48ac783189: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4adbc8d3-971b-4046-8740-4e48ac783189', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Trying to clone 4adbc8d3-971b-4046-8740-4e48ac783189 from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:17:51 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.info" returned: 0 in 0.257s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.670s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] Creating offline snapshot d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a of volume abfae74a-9792-42b4-89c8-a4f52772e39c {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bf4181-98fe-4b95-a548-7296e05836db]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:17:51 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Image download 20.69 MB at 20.69 MB/s Aug 01 15:17:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-74520eb0-1d39-438c-b596-adb762646589 tempest-VolumeImageDependencyTests-883274313 None] Create snapshot completed successfully Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae041e0-559b-42f6-a266-3e7a5a41f7e7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:51 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c Aug 01 15:17:51 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:51 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD Aug 01 15:17:51 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:51 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c" returned: 0 in 0.421s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:51 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a 1G Aug 01 15:17:51 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:51 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:51 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf is fetched for user 515efb5fe5b04ef997d43aa26d5816b5. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a42c99e-f8f8-4900-88d3-f6db5a2b008a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:52 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD Aug 01 15:17:52 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:17:52 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Flow 'volume_create_manager' (75af819d-41ae-4797-a252-ffc262821201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e76895-c3cb-4b1d-a599-8070dc370a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a 1G" returned: 0 in 0.493s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abfae74a-9792-42b4-89c8-a4f52772e39c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e76895-c3cb-4b1d-a599-8070dc370a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-e6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c3b483-e0d4-4998-912e-cea52a17ce9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dad6ad14f4c4afe9f01d86f7e89a88f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1fefb98e-c342-4ad6-a80a-8c8340d846cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:52Z,use_quota=True,user_id='b719d3917b604f5ab42b6e74f12d04b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:52 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abfae74a-9792-42b4-89c8-a4f52772e39c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7515f914-e771-4737-9f29-225bde8e2892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:52 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7515f914-e771-4737-9f29-225bde8e2892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f169b7-6ec8-437f-a9a3-63ba72f6a63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f169b7-6ec8-437f-a9a3-63ba72f6a63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '76c3b483-e0d4-4998-912e-cea52a17ce9d', 'volume_name': 'volume-76c3b483-e0d4-4998-912e-cea52a17ce9d', 'volume_size': 1, 'snapshot_id': '1fefb98e-c342-4ad6-a80a-8c8340d846cd'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:52 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6deccd5e-dc0f-4bd8-a263-e733c0f59f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6deccd5e-dc0f-4bd8-a263-e733c0f59f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81acfee6-fec2-4f9e-a9d1-e4ff570641b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Volume 76c3b483-e0d4-4998-912e-cea52a17ce9d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-76c3b483-e0d4-4998-912e-cea52a17ce9d', 'volume_size': 1, 'snapshot_id': '1fefb98e-c342-4ad6-a80a-8c8340d846cd'} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:52 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abfae74a-9792-42b4-89c8-a4f52772e39c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:52 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a is being set with open permissions: ugo+rw Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:52 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a Aug 01 15:17:52 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:52 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a" returned: 0 in 0.244s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:53 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.info Aug 01 15:17:53 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:53 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.info" returned: 0 in 0.268s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:53 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.info is being set with open permissions: ugo+rw Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:53 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.info Aug 01 15:17:53 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:53 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.info" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.040s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-67690889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adbc8d3-971b-4046-8740-4e48ac783189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='054628ad77cf4b88a010cb1958fc4a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:51Z,use_quota=True,user_id='515efb5fe5b04ef997d43aa26d5816b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Creating volume 4adbc8d3-971b-4046-8740-4e48ac783189 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:17:53 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:53 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 1073741824 Aug 01 15:17:53 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-60e84556-5ae5-4bfb-8735-0ee24d6f0816 tempest-VolumeDependencyTests-1300175653 None] Create snapshot completed successfully Aug 01 15:17:53 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 1073741824" returned: 0 in 0.420s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:54 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 Aug 01 15:17:54 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:54 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189" returned: 0 in 0.272s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.780s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-quobyte-1fefb98e-c342-4ad6-a80a-8c8340d846cd-76c3b483-e0d4-4998-912e-cea52a17ce9d" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Attempting download of a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 4adbc8d3-971b-4046-8740-4e48ac783189. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-1fefb98e-c342-4ad6-a80a-8c8340d846cd-76c3b483-e0d4-4998-912e-cea52a17ce9d" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Creating volume 76c3b483-e0d4-4998-912e-cea52a17ce9d from snapshot 1fefb98e-c342-4ad6-a80a-8c8340d846cd {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-quobyte-76c3b483-e0d4-4998-912e-cea52a17ce9d" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-76c3b483-e0d4-4998-912e-cea52a17ce9d" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] snapshot: 1fefb98e-c342-4ad6-a80a-8c8340d846cd, volume: 76c3b483-e0d4-4998-912e-cea52a17ce9d, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (a6b9f427-454a-4bcd-b848-6a6377ce637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37085c73-dc7d-43ee-8856-cba78d3dcfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc211ce-e153-4965-a0ac-426159862b4d]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_yfu3i7ql {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d856e8f5-6ce5-4a63-8598-6fa88a6a8140]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37085c73-dc7d-43ee-8856-cba78d3dcfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-452552872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5924de-e4e6-4e26-b6db-f518ecab45c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='707b3eb97b844e009925b7bdaeb9690e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:17:54Z,use_quota=True,user_id='f32fd13e887d4fa19a11b22641ff7bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0881ff41-edd9-4b9e-af84-a24e5a2c2596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0881ff41-edd9-4b9e-af84-a24e5a2c2596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c75ec87-1204-414b-818d-1e3a5d4e01fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c75ec87-1204-414b-818d-1e3a5d4e01fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b5924de-e4e6-4e26-b6db-f518ecab45c5', 'volume_name': 'volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5', 'volume_size': 1, 'snapshot_id': 'd71e4b19-09fe-4a0f-8ab4-5adfd98fc96a'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b23b631-1840-4aaa-83ac-3893f936ebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b23b631-1840-4aaa-83ac-3893f936ebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7a20cc-2bd8-4469-82fd-93df225dd2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:54 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Volume 2b5924de-e4e6-4e26-b6db-f518ecab45c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5', 'volume_size': 1, 'snapshot_id': 'd71e4b19-09fe-4a0f-8ab4-5adfd98fc96a'} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:54 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_yfu3i7ql Aug 01 15:17:54 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:54 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd Aug 01 15:17:54 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:54 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_yfu3i7ql" returned: 0 in 0.336s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_yfu3i7ql {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:54 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd" returned: 0 in 0.388s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e4424cf-58b4-45b6-8797-60374d036ac8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7fd7d7-3802-4f46-bad9-286288b779d6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:54 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_yfu3i7ql Aug 01 15:17:54 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:54 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 Aug 01 15:17:54 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:55 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_yfu3i7ql" returned: 1 in 0.326s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_yfu3i7ql' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13914f2-4e37-46c8-98d5-1e2c87407aeb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:55 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD Aug 01 15:17:55 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:55 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8" returned: 0 in 0.416s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:55 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d Aug 01 15:17:55 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:55 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf was qcow2, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:55 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 Aug 01 15:17:55 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:55 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d" returned: 0 in 0.482s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:17:55 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 01 15:17:55 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d is being set with open permissions: ugo+rw Aug 01 15:17:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:55 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d Aug 01 15:17:55 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:56 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d" returned: 0 in 0.283s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-76c3b483-e0d4-4998-912e-cea52a17ce9d" released by "_copy_volume_from_snapshot" :: held 1.695s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-1fefb98e-c342-4ad6-a80a-8c8340d846cd-76c3b483-e0d4-4998-912e-cea52a17ce9d" released by "_create_volume_from_snapshot" :: held 1.773s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.818s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.578s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a-2b5924de-e4e6-4e26-b6db-f518ecab45c5" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Marking volume 76c3b483-e0d4-4998-912e-cea52a17ce9d as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a-2b5924de-e4e6-4e26-b6db-f518ecab45c5" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Creating volume 2b5924de-e4e6-4e26-b6db-f518ecab45c5 from snapshot d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-2b5924de-e4e6-4e26-b6db-f518ecab45c5" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Copying metadata from snapshot 1fefb98e-c342-4ad6-a80a-8c8340d846cd to 76c3b483-e0d4-4998-912e-cea52a17ce9d. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-2b5924de-e4e6-4e26-b6db-f518ecab45c5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] snapshot: d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a, volume: 2b5924de-e4e6-4e26-b6db-f518ecab45c5, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba49e94-4965-4197-926f-1c6477ea7aaa]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81acfee6-fec2-4f9e-a9d1-e4ff570641b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c3b483-e0d4-4998-912e-cea52a17ce9d', 'volume_size': 1, 'snapshot_id': '1fefb98e-c342-4ad6-a80a-8c8340d846cd'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a8692c-65af-4712-b6f5-204f36bb8ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:56 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Volume volume-76c3b483-e0d4-4998-912e-cea52a17ce9d (76c3b483-e0d4-4998-912e-cea52a17ce9d): created successfully Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a8692c-65af-4712-b6f5-204f36bb8ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Flow 'volume_create_manager' (75af819d-41ae-4797-a252-ffc262821201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f229d287-07f1-4541-b9a2-6730d2f55451 tempest-VolumeImageDependencyTests-883274313 None] Created volume successfully. Aug 01 15:17:56 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a Aug 01 15:17:56 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-1fefb98e-c342-4ad6-a80a-8c8340d846cd-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-1fefb98e-c342-4ad6-a80a-8c8340d846cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-quobyte-8e4424cf-58b4-45b6-8797-60374d036ac8" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:56 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a" returned: 0 in 0.471s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abfae74a-9792-42b4-89c8-a4f52772e39c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-8e4424cf-58b4-45b6-8797-60374d036ac8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-quobyte-1fefb98e-c342-4ad6-a80a-8c8340d846cd" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5437a8fb-e507-4773-9179-253b81f79335]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-1fefb98e-c342-4ad6-a80a-8c8340d846cd" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Deleting offline snapshot 1fefb98e-c342-4ad6-a80a-8c8340d846cd of volume 8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] snapshot_file for this snap is: volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4703775b-79ab-43a2-bf21-dbe3c7937f43]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:56 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c Aug 01 15:17:56 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:56 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd Aug 01 15:17:56 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:57 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd" returned: 0 in 0.405s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e4424cf-58b4-45b6-8797-60374d036ac8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:17:57 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c" returned: 0 in 0.490s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b733d3b0-9ea5-4972-b91c-c73309c50c87]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:57 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 Aug 01 15:17:57 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:57 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 Aug 01 15:17:57 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:57 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189" returned: 0 in 1.935s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf_3ofjoz73devstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:17:57 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Converted 112.00 MB image at 57.84 MB/s Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:57 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 1G Aug 01 15:17:57 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:57 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8" returned: 0 in 0.394s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:57 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd Aug 01 15:17:57 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:57 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 1G" returned: 0 in 0.522s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Downloaded image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf ((None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}])) to volume 4adbc8d3-971b-4046-8740-4e48ac783189 successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Temporary image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf for user 515efb5fe5b04ef997d43aa26d5816b5 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:17:57 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Marking volume 4adbc8d3-971b-4046-8740-4e48ac783189 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:17:58 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Copying metadata from image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf to 4adbc8d3-971b-4046-8740-4e48ac783189. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:17:58 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Creating volume glance metadata for volume 4adbc8d3-971b-4046-8740-4e48ac783189 backed by image a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:17:58 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd" returned: 0 in 0.654s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:17:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0be05d7-0495-4055-a2c8-1ad472e04c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4adbc8d3-971b-4046-8740-4e48ac783189', 'volume_size': 1, 'image_id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb1fdd4b3a6d4d0e9d8297724dd584c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf', 'created_at': datetime.datetime(2026, 8, 1, 12, 54, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 12, 54, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4097ffa-d7e5-4048-ad4c-d10b0f9d4fbf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13159cb9-9068-4e60-85cd-fdd9ffe43f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:17:58 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd Aug 01 15:17:58 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:17:58 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Volume volume-4adbc8d3-971b-4046-8740-4e48ac783189 (4adbc8d3-971b-4046-8740-4e48ac783189): created successfully Aug 01 15:17:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13159cb9-9068-4e60-85cd-fdd9ffe43f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:17:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Flow 'volume_create_manager' (b99b88b4-f093-4a43-9c80-240e7a983852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:17:58 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-84d0bf35-e8cb-4d56-b762-cd96f734247d tempest-TestShelveInstance-717043661 None] Created volume successfully. Aug 01 15:17:58 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Aug 01 15:17:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8.1fefb98e-c342-4ad6-a80a-8c8340d846cd" returned: 0 in 0.547s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:17:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-1fefb98e-c342-4ad6-a80a-8c8340d846cd" released by "_delete_snapshot" :: held 2.218s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-8e4424cf-58b4-45b6-8797-60374d036ac8" released by "delete_snapshot" :: held 2.264s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:17:59 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Created reservations ['1ff20665-049d-4f19-9433-28da7e8b393e', '8737c6db-700e-4aa7-806e-4a9fb56f4de1', 'c4b01209-dd65-477c-90f8-65ed5e08d8e8', 'cb7ba02f-ec42-4a79-8f8e-a2102932c89b'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:17:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Delete snapshot completed successfully. Aug 01 15:17:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7fa35d5a-8392-4b08-8b77-a21c5f04ce43 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-1fefb98e-c342-4ad6-a80a-8c8340d846cd-delete_snapshot" released by "delete_snapshot" :: held 2.559s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-76c3b483-e0d4-4998-912e-cea52a17ce9d-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-76c3b483-e0d4-4998-912e-cea52a17ce9d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-quobyte-76c3b483-e0d4-4998-912e-cea52a17ce9d" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-76c3b483-e0d4-4998-912e-cea52a17ce9d" acquired by "delete_volume" :: waited 0.044s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:00 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[def253e0-1365-470e-be44-6bb489a04c26]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:01 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d Aug 01 15:18:01 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:01 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d" returned: 0 in 0.793s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:01 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d Aug 01 15:18:01 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:02 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-76c3b483-e0d4-4998-912e-cea52a17ce9d" returned: 0 in 0.581s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-76c3b483-e0d4-4998-912e-cea52a17ce9d" released by "delete_volume" :: held 1.484s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:02 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Created reservations ['1238ec47-749f-4abd-8bde-83ad64782823', '83760f39-ac9c-4cd8-acda-30bc4f800526', '68ce3025-9ba4-4cc0-8f97-35c121e11ea6', '0dce8bcd-c532-4850-b4aa-0a9b720fcee2'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5" returned: 0 in 5.278s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:18:02 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Converted 1024.00 MB image at 193.95 MB/s Aug 01 15:18:02 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 is being set with open permissions: ugo+rw Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:02 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 Aug 01 15:18:02 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:02 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:02 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:02 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5" returned: 0 in 0.266s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-2b5924de-e4e6-4e26-b6db-f518ecab45c5" released by "_copy_volume_from_snapshot" :: held 6.609s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a-2b5924de-e4e6-4e26-b6db-f518ecab45c5" released by "_create_volume_from_snapshot" :: held 6.684s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.707s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7a20cc-2bd8-4469-82fd-93df225dd2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5', 'volume_size': 1, 'snapshot_id': 'd71e4b19-09fe-4a0f-8ab4-5adfd98fc96a'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228a0297-aed8-496f-b2ca-6943ab219b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:02 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Volume volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 (2b5924de-e4e6-4e26-b6db-f518ecab45c5): created successfully Aug 01 15:18:02 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228a0297-aed8-496f-b2ca-6943ab219b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Flow 'volume_create_manager' (a6b9f427-454a-4bcd-b848-6a6377ce637e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Deleted volume successfully. Aug 01 15:18:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d62a1344-5367-425c-b7de-dd29d0d55b8f tempest-VolumeDependencyTests-1300175653 None] Created volume successfully. Aug 01 15:18:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-994a65fa-6cec-437b-be01-39f8e628d407 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-76c3b483-e0d4-4998-912e-cea52a17ce9d-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-abfae74a-9792-42b4-89c8-a4f52772e39c" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-abfae74a-9792-42b4-89c8-a4f52772e39c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Deleting offline snapshot d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a of volume abfae74a-9792-42b4-89c8-a4f52772e39c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] snapshot_file for this snap is: volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-8e4424cf-58b4-45b6-8797-60374d036ac8-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dd2596-5aff-45a9-969f-818503855182]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-8e4424cf-58b4-45b6-8797-60374d036ac8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-quobyte-8e4424cf-58b4-45b6-8797-60374d036ac8" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:03 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a Aug 01 15:18:03 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-8e4424cf-58b4-45b6-8797-60374d036ac8" acquired by "delete_volume" :: waited 0.041s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[539a5a9a-3e75-42c4-9e5c-df62aa5587c6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:03 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 Aug 01 15:18:03 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:03 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a" returned: 0 in 0.611s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abfae74a-9792-42b4-89c8-a4f52772e39c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03ee086-e752-4206-be49-9becb30cf143]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:04 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c Aug 01 15:18:04 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:04 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8" returned: 0 in 0.594s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:04 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8 Aug 01 15:18:04 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-a3796753-3bd3-4ba9-ad44-8b40928ddb60 req-f4ea4345-e2f8-411a-8a31-db68275827df tempest-TestShelveInstance-717043661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-a3796753-3bd3-4ba9-ad44-8b40928ddb60 req-f4ea4345-e2f8-411a-8a31-db68275827df tempest-TestShelveInstance-717043661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-a3796753-3bd3-4ba9-ad44-8b40928ddb60 req-f4ea4345-e2f8-411a-8a31-db68275827df tempest-TestShelveInstance-717043661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-a3796753-3bd3-4ba9-ad44-8b40928ddb60 req-f4ea4345-e2f8-411a-8a31-db68275827df tempest-TestShelveInstance-717043661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-4adbc8d3-971b-4046-8740-4e48ac783189', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd68323d-3291-4ae5-a149-a997130431ad', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:18:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-a3796753-3bd3-4ba9-ad44-8b40928ddb60 req-f4ea4345-e2f8-411a-8a31-db68275827df tempest-TestShelveInstance-717043661 None] attachment_update completed successfully. Aug 01 15:18:04 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8e4424cf-58b4-45b6-8797-60374d036ac8" returned: 0 in 0.419s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-8e4424cf-58b4-45b6-8797-60374d036ac8" released by "delete_volume" :: held 1.145s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:04 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c" returned: 0 in 0.675s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:04 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a Aug 01 15:18:04 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Created reservations ['96db2678-9e6a-44fc-a72d-37851bae2cc3', '29074524-2ee4-4e31-a212-c3ca984f1c47', 'b136c19e-6ae2-406b-91e2-bf8cd1968e9d', '7a4790f4-76f2-40a9-acd4-231d11959862'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:05 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:05 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:05 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a" returned: 0 in 0.510s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:05 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a Aug 01 15:18:05 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:05 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.308s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:05 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Deleted volume successfully. Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7757b8ba-457b-4999-972f-df7faa96e861 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-8e4424cf-58b4-45b6-8797-60374d036ac8-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:05 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c.d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a" returned: 0 in 0.279s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a" released by "_delete_snapshot" :: held 2.217s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-abfae74a-9792-42b4-89c8-a4f52772e39c" released by "delete_snapshot" :: held 2.244s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Created reservations ['229af956-4f9b-4d99-b34e-3b44dc8a32ea', 'e971e2e1-8bfd-48d4-88d0-072a7443aff2', 'bc2af842-ec62-4f1e-a9d5-de0c6db9b3b1', '36a41224-e304-43f9-baf1-c5937e17bf2d'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:05 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Delete snapshot completed successfully. Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ade70b32-0cf2-48b6-84c3-5abeb3c68c9b tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-d71e4b19-09fe-4a0f-8ab4-5adfd98fc96a-delete_snapshot" released by "delete_snapshot" :: held 2.416s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-503a996b-4150-4714-a42e-689a6f880797-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-503a996b-4150-4714-a42e-689a6f880797-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "cinder-quobyte-503a996b-4150-4714-a42e-689a6f880797" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-503a996b-4150-4714-a42e-689a6f880797" acquired by "delete_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5100447-2ac8-41c8-a2f6-6bd15c904f5c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:06 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797 Aug 01 15:18:06 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:06 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797" returned: 0 in 0.433s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-abfae74a-9792-42b4-89c8-a4f52772e39c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:06 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797 Aug 01 15:18:06 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-abfae74a-9792-42b4-89c8-a4f52772e39c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-abfae74a-9792-42b4-89c8-a4f52772e39c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-abfae74a-9792-42b4-89c8-a4f52772e39c" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1b807d-6f3c-4efa-b2e9-dabb8913e042]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:06 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c Aug 01 15:18:06 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:06 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-503a996b-4150-4714-a42e-689a6f880797" returned: 0 in 0.353s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-quobyte-503a996b-4150-4714-a42e-689a6f880797" released by "delete_volume" :: held 0.852s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Created reservations ['aeb348fc-d328-4e8e-9e70-2d12a61c833e', '49eae08b-a093-4eae-ab84-0513bdf4dfc0', '03dffafb-67bd-4340-8049-de05009ef284', '7f99d96c-b93e-48d1-8749-48e229dd05be'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:07 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:07 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:07 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c" returned: 0 in 0.641s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:07 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c Aug 01 15:18:07 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:07 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Deleted volume successfully. Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1f4acfef-3540-4b4f-af59-9d85521d1495 tempest-VolumeImageDependencyTests-883274313 None] Lock "cinder-503a996b-4150-4714-a42e-689a6f880797-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:07 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-abfae74a-9792-42b4-89c8-a4f52772e39c" returned: 0 in 0.507s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-abfae74a-9792-42b4-89c8-a4f52772e39c" released by "delete_volume" :: held 1.237s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:07 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Created reservations ['95233ec3-71e2-4990-9e47-19029b163962', '9a23d257-5fe6-427a-beac-acfd9e28b381', '8e4710f9-3b4b-4fcf-95c7-22b3d9fe15f5', 'a3135960-fd51-4941-b832-8a2c775c7b1e'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:08 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:08 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:08 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.366s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Deleted volume successfully. Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-945e58ea-cd37-44a8-93bd-a57f1a9c35ef tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-abfae74a-9792-42b4-89c8-a4f52772e39c-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-2b5924de-e4e6-4e26-b6db-f518ecab45c5-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-2b5924de-e4e6-4e26-b6db-f518ecab45c5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "cinder-quobyte-2b5924de-e4e6-4e26-b6db-f518ecab45c5" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-2b5924de-e4e6-4e26-b6db-f518ecab45c5" acquired by "delete_volume" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[baac7a1d-169f-49ff-b9b8-94a0fcf1987f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:09 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 Aug 01 15:18:09 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:09 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5" returned: 0 in 0.505s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:09 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5 Aug 01 15:18:09 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:09 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b5924de-e4e6-4e26-b6db-f518ecab45c5" returned: 0 in 0.260s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-quobyte-2b5924de-e4e6-4e26-b6db-f518ecab45c5" released by "delete_volume" :: held 0.819s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Created reservations ['b852cf77-6dc5-479d-8e54-f994ef73a621', 'd7d92c25-12f6-40d5-afc8-2ebb01ecce30', '51aaf123-dcf0-4022-9290-4d74390bc26d', 'e389459a-bb74-4484-b895-c52a9198ddf4'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:10 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:10 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:10 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.412s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:10 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Deleted volume successfully. Aug 01 15:18:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5dbdf497-a380-4f22-8d37-45e6c89b125c tempest-VolumeDependencyTests-1300175653 None] Lock "cinder-2b5924de-e4e6-4e26-b6db-f518ecab45c5-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Flow 'volume_create_manager' (de51bdaa-4aa3-4496-8b34-5967611ba3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab0c54d-5414-47a4-bed7-82a43ce7532c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab0c54d-5414-47a4-bed7-82a43ce7532c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145212422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341a865a-9fc7-4288-a3d0-2849583130cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d1991214a444d3838eaa370918c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:13Z,use_quota=True,user_id='d0e2db38dbe0413e9356bcb25a8e4ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba59e4c-c0aa-498b-8fb5-4fadf818b46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba59e4c-c0aa-498b-8fb5-4fadf818b46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29a6232-20fe-4e9f-b4e5-3604f9e5022b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29a6232-20fe-4e9f-b4e5-3604f9e5022b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '341a865a-9fc7-4288-a3d0-2849583130cf', 'volume_name': 'volume-341a865a-9fc7-4288-a3d0-2849583130cf', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5329e1c-e49e-4bee-b41d-252663e10c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5329e1c-e49e-4bee-b41d-252663e10c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b09d6c-9190-4872-a281-9f950b8a3fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:13 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Volume 341a865a-9fc7-4288-a3d0-2849583130cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-341a865a-9fc7-4288-a3d0-2849583130cf', 'volume_size': 1} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145212422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341a865a-9fc7-4288-a3d0-2849583130cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d1991214a444d3838eaa370918c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:13Z,use_quota=True,user_id='d0e2db38dbe0413e9356bcb25a8e4ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Creating volume 341a865a-9fc7-4288-a3d0-2849583130cf {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:18:13 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:18:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:13 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf 1073741824 Aug 01 15:18:13 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:14 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf 1073741824" returned: 0 in 0.667s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:14 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf Aug 01 15:18:14 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:14 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf" returned: 0 in 0.413s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:18:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b09d6c-9190-4872-a281-9f950b8a3fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341a865a-9fc7-4288-a3d0-2849583130cf', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5733ec-fcbd-490d-81b9-30ff11361d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:14 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Volume volume-341a865a-9fc7-4288-a3d0-2849583130cf (341a865a-9fc7-4288-a3d0-2849583130cf): created successfully Aug 01 15:18:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5733ec-fcbd-490d-81b9-30ff11361d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Flow 'volume_create_manager' (de51bdaa-4aa3-4496-8b34-5967611ba3d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:14 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cc960a78-d1ad-47ab-ac2f-32b71c68c1cd tempest-ProjectReaderTests-347038312 None] Created volume successfully. Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Flow 'volume_create_manager' (1a8ec741-cd00-43af-8f30-893805667d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c797593b-1b65-47cd-bd42-510a894aa920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c797593b-1b65-47cd-bd42-510a894aa920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b038ace8-3184-419c-a00d-fc2e0950a0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb379dc81aa49eb8668b47d33e5421d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:15Z,use_quota=True,user_id='c8e9c3550a4341c09fe73fd96b57d8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9931eaa8-7459-405a-b0b7-2a7470b1255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9931eaa8-7459-405a-b0b7-2a7470b1255c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9aef32-0ddb-45e8-8848-037391c56411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9aef32-0ddb-45e8-8848-037391c56411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b038ace8-3184-419c-a00d-fc2e0950a0f2', 'volume_name': 'volume-b038ace8-3184-419c-a00d-fc2e0950a0f2', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8db17fe-353d-4562-8af8-ef81a24150b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8db17fe-353d-4562-8af8-ef81a24150b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bed587f-ca9f-443a-8f07-d536dce6ef83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:15 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Volume b038ace8-3184-419c-a00d-fc2e0950a0f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b038ace8-3184-419c-a00d-fc2e0950a0f2', 'volume_size': 1} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b038ace8-3184-419c-a00d-fc2e0950a0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb379dc81aa49eb8668b47d33e5421d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:15Z,use_quota=True,user_id='c8e9c3550a4341c09fe73fd96b57d8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Creating volume b038ace8-3184-419c-a00d-fc2e0950a0f2 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:18:15 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:15 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2 1073741824 Aug 01 15:18:15 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Acquiring lock "cinder-341a865a-9fc7-4288-a3d0-2849583130cf-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Lock "cinder-341a865a-9fc7-4288-a3d0-2849583130cf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Acquiring lock "cinder-quobyte-341a865a-9fc7-4288-a3d0-2849583130cf" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Lock "cinder-quobyte-341a865a-9fc7-4288-a3d0-2849583130cf" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb68731-f695-49cb-b61c-85126acfe063]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:16 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf Aug 01 15:18:16 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:16 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2 1073741824" returned: 0 in 0.685s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:16 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2 Aug 01 15:18:16 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:16 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf" returned: 0 in 0.468s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:16 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf Aug 01 15:18:16 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:16 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bed587f-ca9f-443a-8f07-d536dce6ef83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b038ace8-3184-419c-a00d-fc2e0950a0f2', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef5134c-4cc0-4223-b302-ae3588099eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:16 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Volume volume-b038ace8-3184-419c-a00d-fc2e0950a0f2 (b038ace8-3184-419c-a00d-fc2e0950a0f2): created successfully Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef5134c-4cc0-4223-b302-ae3588099eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Flow 'volume_create_manager' (1a8ec741-cd00-43af-8f30-893805667d4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:16 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-664684e9-9124-46f7-87f6-5c46e5d7723a tempest-CinderUnicodeTest-1189186085 None] Created volume successfully. Aug 01 15:18:16 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-341a865a-9fc7-4288-a3d0-2849583130cf" returned: 0 in 0.283s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Lock "cinder-quobyte-341a865a-9fc7-4288-a3d0-2849583130cf" released by "delete_volume" :: held 0.793s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Created reservations ['345dcd89-912a-42e1-8926-1f12bf8e2724', '6cc46491-1148-43ab-ba67-c6aa722b23eb', 'f05c9269-1121-41eb-965a-062a6c86762a', '13f321c8-d987-4862-8036-f6d889081250'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:17 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:17 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:17 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.253s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:17 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Deleted volume successfully. Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bdcc4aa7-b622-48f1-8814-6e9442c44fb9 tempest-ProjectReaderTests-347038312 None] Lock "cinder-341a865a-9fc7-4288-a3d0-2849583130cf-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Flow 'volume_create_manager' (0e95919d-af7a-4fc0-a4ad-17674358312f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6f65f0-96aa-48fb-973b-58ea2911c92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6f65f0-96aa-48fb-973b-58ea2911c92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1430989472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbcf0b6-8faa-4d1d-87bd-558c1a82b669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d1991214a444d3838eaa370918c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:18Z,use_quota=True,user_id='d0e2db38dbe0413e9356bcb25a8e4ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443086f9-b4d9-4b0e-9ee1-714e5efddf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443086f9-b4d9-4b0e-9ee1-714e5efddf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3e2087-4d26-4dc3-80b6-110fc46f9bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3e2087-4d26-4dc3-80b6-110fc46f9bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dbcf0b6-8faa-4d1d-87bd-558c1a82b669', 'volume_name': 'volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a808db44-acca-400d-a970-d54d709091c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a808db44-acca-400d-a970-d54d709091c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd956b5-bf52-4214-808e-3b46554fa564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:17 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Volume 6dbcf0b6-8faa-4d1d-87bd-558c1a82b669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669', 'volume_size': 1} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1430989472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbcf0b6-8faa-4d1d-87bd-558c1a82b669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d1991214a444d3838eaa370918c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:18Z,use_quota=True,user_id='d0e2db38dbe0413e9356bcb25a8e4ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Creating volume 6dbcf0b6-8faa-4d1d-87bd-558c1a82b669 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:18:17 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:18:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:17 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669 1073741824 Aug 01 15:18:17 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Flow 'volume_create_manager' (abfa7c3a-ae8e-406f-8b18-e3cfe19de05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9ecf58-c4e8-4095-89b4-353dec13a1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9ecf58-c4e8-4095-89b4-353dec13a1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1827007878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2551934-444d-42bf-95ed-0a08246e0b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb379dc81aa49eb8668b47d33e5421d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:18Z,use_quota=True,user_id='c8e9c3550a4341c09fe73fd96b57d8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0aac26-8fd5-4f7d-845c-6c56715cc164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0aac26-8fd5-4f7d-845c-6c56715cc164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834796df-aa8a-44c7-b2ec-a6212cb0b221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834796df-aa8a-44c7-b2ec-a6212cb0b221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2551934-444d-42bf-95ed-0a08246e0b8c', 'volume_name': 'volume-b2551934-444d-42bf-95ed-0a08246e0b8c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b12709-e795-4cc7-bfc0-325e31d8ecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b12709-e795-4cc7-bfc0-325e31d8ecab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e11f91-279c-4f6a-958d-3bc778cba97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:18 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Volume b2551934-444d-42bf-95ed-0a08246e0b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2551934-444d-42bf-95ed-0a08246e0b8c', 'volume_size': 1} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:18 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669 1073741824" returned: 0 in 0.530s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:18 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669 Aug 01 15:18:18 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:18 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:18 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:18 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669" returned: 0 in 0.264s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1827007878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2551934-444d-42bf-95ed-0a08246e0b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb379dc81aa49eb8668b47d33e5421d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:18Z,use_quota=True,user_id='c8e9c3550a4341c09fe73fd96b57d8d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Creating volume b2551934-444d-42bf-95ed-0a08246e0b8c {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:18:18 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:18 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c 1073741824 Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd956b5-bf52-4214-808e-3b46554fa564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:18 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d786cd86-4b54-4cc8-a36a-e2b536927213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:18 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Volume volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669 (6dbcf0b6-8faa-4d1d-87bd-558c1a82b669): created successfully Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d786cd86-4b54-4cc8-a36a-e2b536927213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Flow 'volume_create_manager' (0e95919d-af7a-4fc0-a4ad-17674358312f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-70b10714-34d8-44ee-b203-861d5e9a96a9 tempest-ProjectReaderTests-347038312 None] Created volume successfully. Aug 01 15:18:18 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.303s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:18:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:18:19 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c 1073741824" returned: 0 in 0.488s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:19 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c Aug 01 15:18:19 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:19 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c" returned: 0 in 0.252s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e11f91-279c-4f6a-958d-3bc778cba97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2551934-444d-42bf-95ed-0a08246e0b8c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f1fc4a-013c-4d66-b19d-9c9fa6cc0b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:19 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Volume volume-b2551934-444d-42bf-95ed-0a08246e0b8c (b2551934-444d-42bf-95ed-0a08246e0b8c): created successfully Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f1fc4a-013c-4d66-b19d-9c9fa6cc0b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Flow 'volume_create_manager' (abfa7c3a-ae8e-406f-8b18-e3cfe19de05b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-297c33ce-57b7-43c3-a613-448c1783bf6c tempest-CinderUnicodeTest-1189186085 None] Created volume successfully. Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Acquiring lock "cinder-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Lock "cinder-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Acquiring lock "cinder-quobyte-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Lock "cinder-quobyte-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c308cb88-3541-4246-8234-6a9b4923fb79]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:20 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669 Aug 01 15:18:20 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:20 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669" returned: 0 in 0.397s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:20 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669 Aug 01 15:18:20 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] Creating offline snapshot 627ac08c-1364-4de0-8da2-434789c25915 of volume b2551934-444d-42bf-95ed-0a08246e0b8c {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea8f0a1-6764-4b6c-a184-25874b391403]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:20 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c Aug 01 15:18:20 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:20 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Lock "cinder-quobyte-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669" released by "delete_volume" :: held 0.752s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Created reservations ['26e67a29-1fe5-4e7f-838e-e9b1aeb069fa', '496227a6-0c4d-4ddb-ba9f-89649d4e9750', '005fd666-1747-474b-b2db-591c0339a343', '3fa26791-871d-44ed-bb3c-cf67c66d44a5'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:20 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:20 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:20 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c" returned: 0 in 0.396s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:20 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 1G Aug 01 15:18:20 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:21 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:21 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Deleted volume successfully. Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a6a61b7d-3c3f-41b4-9ff7-a6fc2ca76e5f tempest-ProjectReaderTests-347038312 None] Lock "cinder-6dbcf0b6-8faa-4d1d-87bd-558c1a82b669-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:21 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 1G" returned: 0 in 0.594s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2551934-444d-42bf-95ed-0a08246e0b8c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:21 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2551934-444d-42bf-95ed-0a08246e0b8c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 Aug 01 15:18:21 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Flow 'volume_create_manager' (5c15a65a-7fc1-406a-a140-5595f1953e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159f9ad8-7ff2-451c-a5b0-a44d7cef705d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159f9ad8-7ff2-451c-a5b0-a44d7cef705d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-69038370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d1991214a444d3838eaa370918c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:21Z,use_quota=True,user_id='d0e2db38dbe0413e9356bcb25a8e4ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf42866-42e3-453c-8717-535982ad8791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf42866-42e3-453c-8717-535982ad8791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2f5ff7-c712-4e5b-baab-4fc653c4ef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2f5ff7-c712-4e5b-baab-4fc653c4ef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4', 'volume_name': 'volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01a39e5-158e-4b51-b7a6-cd78512a5d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01a39e5-158e-4b51-b7a6-cd78512a5d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d516166a-b497-4f50-86f7-059640c243f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:21 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Volume 98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4', 'volume_size': 1} Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:21 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2551934-444d-42bf-95ed-0a08246e0b8c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915" returned: 0 in 0.374s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:21 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 is being set with open permissions: ugo+rw Aug 01 15:18:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:21 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 Aug 01 15:18:21 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:22 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915" returned: 0 in 0.273s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:22 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.info Aug 01 15:18:22 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:22 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.info" returned: 0 in 0.254s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:22 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.info is being set with open permissions: ugo+rw Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:22 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.info Aug 01 15:18:22 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:22 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.info" returned: 0 in 0.268s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.987s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-69038370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d1991214a444d3838eaa370918c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:21Z,use_quota=True,user_id='d0e2db38dbe0413e9356bcb25a8e4ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Creating volume 98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:18:22 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:18:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:22 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4 1073741824 Aug 01 15:18:22 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:22 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3371a321-a975-410a-bcb0-5b8da438c2a3 tempest-CinderUnicodeTest-1189186085 None] Create snapshot completed successfully Aug 01 15:18:23 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4 1073741824" returned: 0 in 0.433s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:23 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4 Aug 01 15:18:23 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:23 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4" returned: 0 in 0.270s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d516166a-b497-4f50-86f7-059640c243f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b222f7c-e8e4-40f3-851a-d770e1cba38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:23 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Volume volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4 (98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4): created successfully Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b222f7c-e8e4-40f3-851a-d770e1cba38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Flow 'volume_create_manager' (5c15a65a-7fc1-406a-a140-5595f1953e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4ab68219-a18f-456a-8d2c-353058c25821 tempest-ProjectReaderTests-347038312 None] Created volume successfully. Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "cinder-627ac08c-1364-4de0-8da2-434789c25915-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-627ac08c-1364-4de0-8da2-434789c25915-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "cinder-quobyte-b2551934-444d-42bf-95ed-0a08246e0b8c" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-quobyte-b2551934-444d-42bf-95ed-0a08246e0b8c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "cinder-quobyte-627ac08c-1364-4de0-8da2-434789c25915" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-quobyte-627ac08c-1364-4de0-8da2-434789c25915" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Deleting offline snapshot 627ac08c-1364-4de0-8da2-434789c25915 of volume b2551934-444d-42bf-95ed-0a08246e0b8c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] snapshot_file for this snap is: volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[be84d2d8-bf95-4146-b8ea-ff26049cc84a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Acquiring lock "cinder-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Lock "cinder-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Acquiring lock "cinder-quobyte-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Lock "cinder-quobyte-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:23 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 Aug 01 15:18:23 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7993e329-8d47-4805-97c4-014d1a5df488]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:24 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4 Aug 01 15:18:24 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:24 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915" returned: 0 in 0.410s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2551934-444d-42bf-95ed-0a08246e0b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a557f7b0-1f94-4371-8f32-e244b979293a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:24 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c Aug 01 15:18:24 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:24 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4" returned: 0 in 0.399s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:24 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4 Aug 01 15:18:24 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:24 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c" returned: 0 in 0.381s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:24 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4" returned: 0 in 0.281s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:24 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 Aug 01 15:18:24 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Lock "cinder-quobyte-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4" released by "delete_volume" :: held 0.725s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Created reservations ['c95d87e7-e5a7-4618-abd6-d46cabf24b5c', '1abeb382-cd09-43d7-b781-53bf02e3b488', '038f73eb-92d3-4b1c-9172-47303dd29d8c', 'c34148a4-4125-40cc-838a-7d818ab06f7d'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:24 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:24 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:24 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915" returned: 0 in 0.387s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:24 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915 Aug 01 15:18:24 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:25 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.317s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:25 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Deleted volume successfully. Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bda5d419-2e27-44a8-a1f7-bb87ccccbe7d tempest-ProjectReaderTests-347038312 None] Lock "cinder-98db99ae-64f7-4ea4-8a06-f27d0f0d8bf4-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:25 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c.627ac08c-1364-4de0-8da2-434789c25915" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-quobyte-627ac08c-1364-4de0-8da2-434789c25915" released by "_delete_snapshot" :: held 1.608s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-quobyte-b2551934-444d-42bf-95ed-0a08246e0b8c" released by "delete_snapshot" :: held 1.640s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Created reservations ['c05612bf-afe1-4e97-ac97-3b025b41e224', '0af5885e-3d81-401d-b43e-42bbb6ae4b85', '084e5790-f019-4705-be9b-84afa24ba287', '11b0f62f-b234-41a4-b5a4-58f2053df839'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:25 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Delete snapshot completed successfully. Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f6fe4d0b-76f2-4e75-a08e-ca3da35a4265 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-627ac08c-1364-4de0-8da2-434789c25915-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Flow 'volume_create_manager' (cc461896-de7b-4d04-ad03-ed1443424e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe270e05-98b6-4a96-9c48-cb764f449bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe270e05-98b6-4a96-9c48-cb764f449bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118822894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069d46ed-0c75-4b78-8ea5-25651ee4ba10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d1991214a444d3838eaa370918c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:25Z,use_quota=True,user_id='d0e2db38dbe0413e9356bcb25a8e4ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a52ac9b-3186-4bea-9bfb-305a28a574a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a52ac9b-3186-4bea-9bfb-305a28a574a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d928198-d0a2-4e61-8c80-e081de6d4c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d928198-d0a2-4e61-8c80-e081de6d4c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '069d46ed-0c75-4b78-8ea5-25651ee4ba10', 'volume_name': 'volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c03ec8-7cd7-48e7-acb7-4fd96dd4f5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c03ec8-7cd7-48e7-acb7-4fd96dd4f5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (864ea491-acb0-4109-91fb-535c21d9c1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:25 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Volume 069d46ed-0c75-4b78-8ea5-25651ee4ba10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10', 'volume_size': 1} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118822894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069d46ed-0c75-4b78-8ea5-25651ee4ba10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24d1991214a444d3838eaa370918c6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:25Z,use_quota=True,user_id='d0e2db38dbe0413e9356bcb25a8e4ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Creating volume 069d46ed-0c75-4b78-8ea5-25651ee4ba10 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:18:25 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:25 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10 1073741824 Aug 01 15:18:25 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "cinder-b2551934-444d-42bf-95ed-0a08246e0b8c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-b2551934-444d-42bf-95ed-0a08246e0b8c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "cinder-quobyte-b2551934-444d-42bf-95ed-0a08246e0b8c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-quobyte-b2551934-444d-42bf-95ed-0a08246e0b8c" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8158e86-1486-476a-8ee1-fe44f5e1fff4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:26 devstack sudo[108895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c Aug 01 15:18:26 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:26 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10 1073741824" returned: 0 in 0.553s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:26 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10 Aug 01 15:18:26 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:26 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c" returned: 0 in 0.445s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:26 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c Aug 01 15:18:26 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:26 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (864ea491-acb0-4109-91fb-535c21d9c1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567e3929-c96b-458e-b8f0-36ef4945ceb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:26 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Volume volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10 (069d46ed-0c75-4b78-8ea5-25651ee4ba10): created successfully Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567e3929-c96b-458e-b8f0-36ef4945ceb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Flow 'volume_create_manager' (cc461896-de7b-4d04-ad03-ed1443424e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3af4da59-3582-4957-b68c-daa339f3d73c tempest-ProjectReaderTests-347038312 None] Created volume successfully. Aug 01 15:18:26 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b2551934-444d-42bf-95ed-0a08246e0b8c" returned: 0 in 0.326s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-quobyte-b2551934-444d-42bf-95ed-0a08246e0b8c" released by "delete_volume" :: held 0.845s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Created reservations ['1b181e9e-24d1-49e2-80aa-4985a94348da', 'b0059540-b3f2-4b0d-879c-0e1034c49a6d', '4f0c47d6-2248-4e5d-a3fc-55c50a49099b', '85ade9cf-d37e-4a49-8a53-a3c83f87d416'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:26 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:26 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "cinder-b038ace8-3184-419c-a00d-fc2e0950a0f2-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-b038ace8-3184-419c-a00d-fc2e0950a0f2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "cinder-quobyte-b038ace8-3184-419c-a00d-fc2e0950a0f2" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-quobyte-b038ace8-3184-419c-a00d-fc2e0950a0f2" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:27 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.298s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:27 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Deleted volume successfully. Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d3f23c-832f-4890-9560-d14edc00ecb6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-801c41fe-fa60-466f-aa25-41f94cc8e0d8 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-b2551934-444d-42bf-95ed-0a08246e0b8c-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:27 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2 Aug 01 15:18:27 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:27 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2" returned: 0 in 0.387s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:27 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2 Aug 01 15:18:27 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Acquiring lock "cinder-069d46ed-0c75-4b78-8ea5-25651ee4ba10-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Lock "cinder-069d46ed-0c75-4b78-8ea5-25651ee4ba10-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Acquiring lock "cinder-quobyte-069d46ed-0c75-4b78-8ea5-25651ee4ba10" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Lock "cinder-quobyte-069d46ed-0c75-4b78-8ea5-25651ee4ba10" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[14670b64-4d1b-4ed2-816b-3a574506c949]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:27 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10 Aug 01 15:18:27 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:27 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b038ace8-3184-419c-a00d-fc2e0950a0f2" returned: 0 in 0.262s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-quobyte-b038ace8-3184-419c-a00d-fc2e0950a0f2" released by "delete_volume" :: held 0.701s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Created reservations ['70919575-cff7-499d-b4a9-3e28c357b3c7', '668f34e0-d2e0-42f8-b8e3-94d23dbf49e0', 'a171a7bb-b7fc-498c-9092-bbc3e29ca067', 'f1535866-d607-4cf3-a26d-45244f6aa148'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:28 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:28 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:28 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10" returned: 0 in 0.366s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:28 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10 Aug 01 15:18:28 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:28 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.262s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:28 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Deleted volume successfully. Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3bf1976e-915e-4501-96c1-5ad9616e8049 tempest-CinderUnicodeTest-1189186085 None] Lock "cinder-b038ace8-3184-419c-a00d-fc2e0950a0f2-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:28 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-069d46ed-0c75-4b78-8ea5-25651ee4ba10" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Lock "cinder-quobyte-069d46ed-0c75-4b78-8ea5-25651ee4ba10" released by "delete_volume" :: held 0.686s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Created reservations ['66cd73e4-fe8b-4d6a-b6bd-dd03ef016299', '2811c616-3875-4aca-97c9-6c7f08e8e896', '4d594dc7-6591-4919-817c-42a2773759ca', 'aa6d051c-4b0b-455d-803d-3605f2db160e'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:28 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:18:28 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:28 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.250s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:18:28 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Deleted volume successfully. Aug 01 15:18:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ecce6f67-f450-497c-9457-82456e554785 tempest-ProjectReaderTests-347038312 None] Lock "cinder-069d46ed-0c75-4b78-8ea5-25651ee4ba10-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:18:38 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=163,cinder:INSERT=61,cinder:UPDATE=194,cinder:DELETE=14 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:18:38 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=142,cinder:UPDATE=165,cinder:INSERT=66,cinder:DELETE=16 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:18:41 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-3d87c7b8-f7b9-4e9c-80df-fd17f65e1fe6 req-966a8440-4dd8-4571-ac0c-8cdad7087d72 tempest-TestShelveInstance-717043661 None] Terminate volume connection completed successfully. Aug 01 15:18:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-3d87c7b8-f7b9-4e9c-80df-fd17f65e1fe6 req-966a8440-4dd8-4571-ac0c-8cdad7087d72 tempest-TestShelveInstance-717043661 None] Deleting attachment cd68323d-3291-4ae5-a149-a997130431ad. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:18:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1fa8adb3-bb39-4278-b1cd-2ceb003c7045 req-336d29d4-895f-4ff4-8d08-086404ebac8d tempest-TestShelveInstance-717043661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1fa8adb3-bb39-4278-b1cd-2ceb003c7045 req-336d29d4-895f-4ff4-8d08-086404ebac8d tempest-TestShelveInstance-717043661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-1fa8adb3-bb39-4278-b1cd-2ceb003c7045 req-336d29d4-895f-4ff4-8d08-086404ebac8d tempest-TestShelveInstance-717043661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-1fa8adb3-bb39-4278-b1cd-2ceb003c7045 req-336d29d4-895f-4ff4-8d08-086404ebac8d tempest-TestShelveInstance-717043661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-4adbc8d3-971b-4046-8740-4e48ac783189', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb39c787-e288-419d-9af5-de1cb4a8f806', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:18:44 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-1fa8adb3-bb39-4278-b1cd-2ceb003c7045 req-336d29d4-895f-4ff4-8d08-086404ebac8d tempest-TestShelveInstance-717043661 None] attachment_update completed successfully. Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Flow 'volume_create_manager' (6a0cbbb9-78bd-4ced-8686-41ed8cf21432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ee82ca-e928-4667-b94b-b50280b391ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ee82ca-e928-4667-b94b-b50280b391ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1895230563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b2024c-53e4-41e1-bd11-e9c75d33a73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4066ec4a2b8940bb8bdee23d7a4ae8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:52Z,use_quota=True,user_id='78672d8683734eacbbc9fe5f52391ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f8e1eb-a298-4c46-8af9-8b8545b9d774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f8e1eb-a298-4c46-8af9-8b8545b9d774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1416ffb0-f7ef-4b33-80a9-fc131f498990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1416ffb0-f7ef-4b33-80a9-fc131f498990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b2024c-53e4-41e1-bd11-e9c75d33a73a', 'volume_name': 'volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f0b4ac-1c12-4daf-84b9-413aaf785c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f0b4ac-1c12-4daf-84b9-413aaf785c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c9bf17-013e-4399-ab8b-9d374d6b668f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Volume 04b2024c-53e4-41e1-bd11-e9c75d33a73a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a', 'volume_size': 1} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1895230563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b2024c-53e4-41e1-bd11-e9c75d33a73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4066ec4a2b8940bb8bdee23d7a4ae8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:52Z,use_quota=True,user_id='78672d8683734eacbbc9fe5f52391ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Creating volume 04b2024c-53e4-41e1-bd11-e9c75d33a73a {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:18:52 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:52 devstack sudo[109488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a 1073741824 Aug 01 15:18:52 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:52 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a 1073741824" returned: 0 in 0.616s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:52 devstack sudo[109494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a Aug 01 15:18:52 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:53 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a" returned: 0 in 0.278s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:18:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c9bf17-013e-4399-ab8b-9d374d6b668f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600fca8c-87dc-41ae-bcb0-0b9a35eef019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:53 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Volume volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a (04b2024c-53e4-41e1-bd11-e9c75d33a73a): created successfully Aug 01 15:18:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600fca8c-87dc-41ae-bcb0-0b9a35eef019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Flow 'volume_create_manager' (6a0cbbb9-78bd-4ced-8686-41ed8cf21432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a6380f50-8b1c-4072-980d-105afa87770e tempest-SnapshotDependencyTests-1753523664 None] Created volume successfully. Aug 01 15:18:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] Creating offline snapshot 127d5356-ea44-43ab-bb0d-c81ea070cede of volume 04b2024c-53e4-41e1-bd11-e9c75d33a73a {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:18:54 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4b263f-198f-4b6e-a7e2-179537859584]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:54 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a Aug 01 15:18:54 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:54 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a" returned: 0 in 0.389s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:54 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede 1G Aug 01 15:18:54 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:55 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede 1G" returned: 0 in 0.435s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:55 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede Aug 01 15:18:55 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:55 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede" returned: 0 in 0.297s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:55 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede is being set with open permissions: ugo+rw Aug 01 15:18:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:55 devstack sudo[109512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede Aug 01 15:18:55 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:55 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede" returned: 0 in 0.257s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:55 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.info Aug 01 15:18:55 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:56 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.info" returned: 0 in 0.255s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:56 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.info is being set with open permissions: ugo+rw Aug 01 15:18:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:56 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.info Aug 01 15:18:56 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:56 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.info" returned: 0 in 0.250s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b5804acb-590e-4049-bf08-ebf72938ab5c tempest-SnapshotDependencyTests-1753523664 None] Create snapshot completed successfully Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Flow 'volume_create_manager' (c533d670-ed29-43d9-a3f0-39f26c07cfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab28bc5-8f44-49e1-9738-a493138f8e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab28bc5-8f44-49e1-9738-a493138f8e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=913f2a21-c929-4da4-8417-b32bf951cfea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4066ec4a2b8940bb8bdee23d7a4ae8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=127d5356-ea44-43ab-bb0d-c81ea070cede,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:18:57Z,use_quota=True,user_id='78672d8683734eacbbc9fe5f52391ee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d924af0-3338-4953-859c-86f0c51af6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d924af0-3338-4953-859c-86f0c51af6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c902dd-3d2a-480a-a0b6-b933c085e94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c902dd-3d2a-480a-a0b6-b933c085e94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '913f2a21-c929-4da4-8417-b32bf951cfea', 'volume_name': 'volume-913f2a21-c929-4da4-8417-b32bf951cfea', 'volume_size': 1, 'snapshot_id': '127d5356-ea44-43ab-bb0d-c81ea070cede'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c38036f-264f-4a89-9d90-035a91cf3330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c38036f-264f-4a89-9d90-035a91cf3330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63118e8c-6620-4a08-94ae-4042d9ae9265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:18:57 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Volume 913f2a21-c929-4da4-8417-b32bf951cfea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-913f2a21-c929-4da4-8417-b32bf951cfea', 'volume_size': 1, 'snapshot_id': '127d5356-ea44-43ab-bb0d-c81ea070cede'} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "cinder-quobyte-127d5356-ea44-43ab-bb0d-c81ea070cede-913f2a21-c929-4da4-8417-b32bf951cfea" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-127d5356-ea44-43ab-bb0d-c81ea070cede-913f2a21-c929-4da4-8417-b32bf951cfea" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Creating volume 913f2a21-c929-4da4-8417-b32bf951cfea from snapshot 127d5356-ea44-43ab-bb0d-c81ea070cede {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "cinder-quobyte-913f2a21-c929-4da4-8417-b32bf951cfea" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-913f2a21-c929-4da4-8417-b32bf951cfea" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] snapshot: 127d5356-ea44-43ab-bb0d-c81ea070cede, volume: 913f2a21-c929-4da4-8417-b32bf951cfea, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[780c6727-8ca8-4e78-886b-a2ccae1f65f1]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:57 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede Aug 01 15:18:57 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:57 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede" returned: 0 in 0.387s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fd504e-f0f5-4f21-bb44-5ccf0e91b659]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:18:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:57 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a Aug 01 15:18:57 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:18:58 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Aug 01 15:18:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a" returned: 0 in 0.386s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:18:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:18:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:18:58 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:18:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:18:58 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea Aug 01 15:18:58 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:03 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea" returned: 0 in 5.412s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:03 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:19:03 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Converted 1024.00 MB image at 189.16 MB/s Aug 01 15:19:03 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea is being set with open permissions: ugo+rw Aug 01 15:19:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:03 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea Aug 01 15:19:03 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:03 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea" returned: 0 in 0.295s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-913f2a21-c929-4da4-8417-b32bf951cfea" released by "_copy_volume_from_snapshot" :: held 6.577s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-127d5356-ea44-43ab-bb0d-c81ea070cede-913f2a21-c929-4da4-8417-b32bf951cfea" released by "_create_volume_from_snapshot" :: held 6.675s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.695s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63118e8c-6620-4a08-94ae-4042d9ae9265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-913f2a21-c929-4da4-8417-b32bf951cfea', 'volume_size': 1, 'snapshot_id': '127d5356-ea44-43ab-bb0d-c81ea070cede'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5858d4-e048-428c-89df-9af6e08450dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Volume volume-913f2a21-c929-4da4-8417-b32bf951cfea (913f2a21-c929-4da4-8417-b32bf951cfea): created successfully Aug 01 15:19:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5858d4-e048-428c-89df-9af6e08450dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Flow 'volume_create_manager' (c533d670-ed29-43d9-a3f0-39f26c07cfd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f2c29e40-b940-469a-9160-09dd59a858ba tempest-SnapshotDependencyTests-1753523664 None] Created volume successfully. Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "cinder-127d5356-ea44-43ab-bb0d-c81ea070cede-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-127d5356-ea44-43ab-bb0d-c81ea070cede-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "cinder-quobyte-04b2024c-53e4-41e1-bd11-e9c75d33a73a" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-04b2024c-53e4-41e1-bd11-e9c75d33a73a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "cinder-quobyte-127d5356-ea44-43ab-bb0d-c81ea070cede" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-127d5356-ea44-43ab-bb0d-c81ea070cede" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Deleting offline snapshot 127d5356-ea44-43ab-bb0d-c81ea070cede of volume 04b2024c-53e4-41e1-bd11-e9c75d33a73a {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] snapshot_file for this snap is: volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d96506-55f8-44c8-ab4d-e2ce8246f09d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:05 devstack sudo[109563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede Aug 01 15:19:05 devstack sudo[109563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:05 devstack sudo[109563]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede" returned: 0 in 0.364s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76319f3-5b67-459f-939a-53fdcb16e73f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:05 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a Aug 01 15:19:05 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:06 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a" returned: 0 in 0.547s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:06 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede Aug 01 15:19:06 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:06 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede" returned: 0 in 0.332s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:06 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede Aug 01 15:19:06 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:06 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a.127d5356-ea44-43ab-bb0d-c81ea070cede" returned: 0 in 0.253s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-127d5356-ea44-43ab-bb0d-c81ea070cede" released by "_delete_snapshot" :: held 1.593s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-04b2024c-53e4-41e1-bd11-e9c75d33a73a" released by "delete_snapshot" :: held 1.620s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Created reservations ['a6a187f7-bb18-486c-8709-0b869c48857f', '1b0394fa-1351-4755-8fc7-024dd856a9ce', '32207c55-9839-4ba7-8445-4b7c94592f80', '37a14336-611f-4443-b576-56671bf828b4'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:19:06 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Delete snapshot completed successfully. Aug 01 15:19:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a1baa7e2-cb5d-401c-90de-8363b1134582 tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-127d5356-ea44-43ab-bb0d-c81ea070cede-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "cinder-04b2024c-53e4-41e1-bd11-e9c75d33a73a-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-04b2024c-53e4-41e1-bd11-e9c75d33a73a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "cinder-quobyte-04b2024c-53e4-41e1-bd11-e9c75d33a73a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-04b2024c-53e4-41e1-bd11-e9c75d33a73a" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad7b2e9-957b-44c2-95ff-ae4d6640271b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:07 devstack sudo[109605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a Aug 01 15:19:07 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:07 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a" returned: 0 in 0.364s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:07 devstack sudo[109610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a Aug 01 15:19:07 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:07 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-04b2024c-53e4-41e1-bd11-e9c75d33a73a" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-04b2024c-53e4-41e1-bd11-e9c75d33a73a" released by "delete_volume" :: held 0.667s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:07 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Created reservations ['752de89e-1dd0-460b-b080-6ca18e72d862', '63d06cd0-ac4a-42e1-be6f-e4e51bb700f8', '6a1e0322-39e6-4520-b8ea-8926f90c7282', 'b79a9e10-d881-407c-a891-db51b32e5536'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:08 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:19:08 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:08 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.242s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:19:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Deleted volume successfully. Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-18bd192d-4adc-403d-81a3-00644d7bc633 tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-04b2024c-53e4-41e1-bd11-e9c75d33a73a-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "cinder-913f2a21-c929-4da4-8417-b32bf951cfea-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-913f2a21-c929-4da4-8417-b32bf951cfea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "cinder-quobyte-913f2a21-c929-4da4-8417-b32bf951cfea" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-913f2a21-c929-4da4-8417-b32bf951cfea" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8480648-87cf-4392-897a-eaf3816d045c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:08 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea Aug 01 15:19:08 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:08 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea" returned: 0 in 0.355s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:08 devstack sudo[109621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea Aug 01 15:19:08 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:09 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-913f2a21-c929-4da4-8417-b32bf951cfea" returned: 0 in 0.248s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-quobyte-913f2a21-c929-4da4-8417-b32bf951cfea" released by "delete_volume" :: held 0.643s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Created reservations ['43dadfe6-1b8a-4d65-b7f3-8cf8fb708c42', '6d6f90f1-54ff-448b-8ac0-fcbef348c591', 'e43b8d79-8060-4c93-80da-ce260fdbfc28', 'be64e89c-5ae0-4cff-9234-c54551602b87'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:09 devstack sudo[109624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:19:09 devstack sudo[109624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:09 devstack sudo[109624]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.247s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:19:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Deleted volume successfully. Aug 01 15:19:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e6e9efe1-a19c-4b58-902e-acf04950650d tempest-SnapshotDependencyTests-1753523664 None] Lock "cinder-913f2a21-c929-4da4-8417-b32bf951cfea-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:18 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:19:18 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:18 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.317s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:19:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:19:19 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=37,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=7 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:19:19 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=28,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=2 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:19:29 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-6798e95c-884e-4790-83d4-3efb1a887870 req-35c367ac-8f0c-4901-8427-98124983748f tempest-TestShelveInstance-717043661 None] Terminate volume connection completed successfully. Aug 01 15:19:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6798e95c-884e-4790-83d4-3efb1a887870 req-35c367ac-8f0c-4901-8427-98124983748f tempest-TestShelveInstance-717043661 None] Deleting attachment eb39c787-e288-419d-9af5-de1cb4a8f806. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:19:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Acquiring lock "cinder-4adbc8d3-971b-4046-8740-4e48ac783189-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Lock "cinder-4adbc8d3-971b-4046-8740-4e48ac783189-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Acquiring lock "cinder-quobyte-4adbc8d3-971b-4046-8740-4e48ac783189" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Lock "cinder-quobyte-4adbc8d3-971b-4046-8740-4e48ac783189" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:30 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b94ce53-867c-4ba1-9549-0c99fe434031]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:30 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 Aug 01 15:19:30 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:30 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189" returned: 0 in 0.398s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:30 devstack sudo[109721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189 Aug 01 15:19:30 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:30 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4adbc8d3-971b-4046-8740-4e48ac783189" returned: 0 in 0.246s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Lock "cinder-quobyte-4adbc8d3-971b-4046-8740-4e48ac783189" released by "delete_volume" :: held 0.686s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:30 devstack cinder-volume[89024]: DEBUG cinder.quota [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Created reservations ['a3b171c8-b1a0-4afd-9236-b0ff961eefbb', 'c51bd4f3-249e-4f66-9599-0c0badbe16e4', '17f403c1-c336-4ee5-99c1-9674ca9ed5a1', '5eb74fc4-7d90-418d-b6cf-d80fa01a9e07'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:19:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:31 devstack sudo[109724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:19:31 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:31 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:31 devstack cinder-volume[89024]: DEBUG cinder.manager [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:19:31 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Deleted volume successfully. Aug 01 15:19:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [req-6798e95c-884e-4790-83d4-3efb1a887870 req-e7af966c-8d80-4645-90ad-f09fea8d6f85 tempest-TestShelveInstance-717043661 None] Lock "cinder-4adbc8d3-971b-4046-8740-4e48ac783189-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (7d0a3163-b7c6-40a8-b666-3cce0e6dd509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e175bc-8338-43f9-a703-36e8ba173f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e175bc-8338-43f9-a703-36e8ba173f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1380661474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b48e802-5a32-4eb7-81d3-8a80c8c8d92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:41Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70967df-ff54-4b62-8ce9-a986c9e6c80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70967df-ff54-4b62-8ce9-a986c9e6c80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1b4892-a4ff-402b-9950-86ebda6fe722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1b4892-a4ff-402b-9950-86ebda6fe722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b48e802-5a32-4eb7-81d3-8a80c8c8d92c', 'volume_name': 'volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61091a6-db07-427a-9825-f46a49c55519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61091a6-db07-427a-9825-f46a49c55519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17af79e-8aed-4857-9429-e157541b4408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:40 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume 4b48e802-5a32-4eb7-81d3-8a80c8c8d92c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c', 'volume_size': 1} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1380661474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b48e802-5a32-4eb7-81d3-8a80c8c8d92c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:41Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Creating volume 4b48e802-5a32-4eb7-81d3-8a80c8c8d92c {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:19:40 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:19:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:41 devstack sudo[109732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c 1073741824 Aug 01 15:19:41 devstack sudo[109732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:41 devstack sudo[109732]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c 1073741824" returned: 0 in 0.393s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:41 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c Aug 01 15:19:41 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:41 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c" returned: 0 in 0.239s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:19:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17af79e-8aed-4857-9429-e157541b4408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2b0215-8e59-4c73-ae8f-9373db6bff45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:41 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c (4b48e802-5a32-4eb7-81d3-8a80c8c8d92c): created successfully Aug 01 15:19:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2b0215-8e59-4c73-ae8f-9373db6bff45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (7d0a3163-b7c6-40a8-b666-3cce0e6dd509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:41 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-10ae276e-2b92-4d58-a959-3a721fb5efdc tempest-CreateVolumesFromSnapshotTest-627643036 None] Created volume successfully. Aug 01 15:19:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] Creating offline snapshot 80a73953-4466-4b25-b9b0-964d914ac001 of volume 4b48e802-5a32-4eb7-81d3-8a80c8c8d92c {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:19:42 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[066fe4d7-94e5-4474-8496-c2f17922c1b8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:42 devstack sudo[109741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c Aug 01 15:19:42 devstack sudo[109741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:42 devstack sudo[109741]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c" returned: 0 in 0.356s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:42 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 1G Aug 01 15:19:42 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:43 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 1G" returned: 0 in 0.379s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:43 devstack sudo[109751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 Aug 01 15:19:43 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:43 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001" returned: 0 in 0.304s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:43 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 is being set with open permissions: ugo+rw Aug 01 15:19:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:43 devstack sudo[109756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 Aug 01 15:19:43 devstack sudo[109756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:43 devstack sudo[109756]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001" returned: 0 in 0.243s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:43 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.info Aug 01 15:19:43 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:43 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.info" returned: 0 in 0.250s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:43 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.info is being set with open permissions: ugo+rw Aug 01 15:19:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:43 devstack sudo[109762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.info Aug 01 15:19:43 devstack sudo[109762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:44 devstack sudo[109762]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.info" returned: 0 in 0.244s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:44 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-bc90a33a-3d50-4131-87c7-42d01858f85d tempest-CreateVolumesFromSnapshotTest-627643036 None] Create snapshot completed successfully Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (60757ff5-67b7-425f-8f73-b203241a7f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1288bacc-f2b6-4fe1-b8b1-f8b51091872b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1288bacc-f2b6-4fe1-b8b1-f8b51091872b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1675421306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc71fb2-2828-4721-9696-e893214aeedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:45Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e08312-3b94-4ea9-a5ea-b5808297f54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e08312-3b94-4ea9-a5ea-b5808297f54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f45a09-8a9d-4a74-870e-70411a2e952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f45a09-8a9d-4a74-870e-70411a2e952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc71fb2-2828-4721-9696-e893214aeedf', 'volume_name': 'volume-5bc71fb2-2828-4721-9696-e893214aeedf', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52939491-68fd-48bb-8810-c3665d4ac098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52939491-68fd-48bb-8810-c3665d4ac098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f4375a-4d26-4e34-896d-88368e411eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:44 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume 5bc71fb2-2828-4721-9696-e893214aeedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc71fb2-2828-4721-9696-e893214aeedf', 'volume_size': 1} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1675421306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc71fb2-2828-4721-9696-e893214aeedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:45Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Creating volume 5bc71fb2-2828-4721-9696-e893214aeedf {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:19:44 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:19:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:44 devstack sudo[109765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf 1073741824 Aug 01 15:19:44 devstack sudo[109765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (84d2d9e4-8012-4574-b427-dc4ebea06a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce4f0f9-a862-4b49-97c9-7adafb831e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce4f0f9-a862-4b49-97c9-7adafb831e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-539252280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef99771e-67d1-43a8-9050-f6efce01bee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:45Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dfb123-177a-48eb-ad18-9903654210a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dfb123-177a-48eb-ad18-9903654210a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2040f602-f441-42fe-91af-d0ed891fd49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2040f602-f441-42fe-91af-d0ed891fd49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef99771e-67d1-43a8-9050-f6efce01bee7', 'volume_name': 'volume-ef99771e-67d1-43a8-9050-f6efce01bee7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6078abd-90c3-4f29-9312-ebbc94300dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6078abd-90c3-4f29-9312-ebbc94300dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8dbb2c9-2b2e-4d4a-8649-79d8ca9b91fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:45 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume ef99771e-67d1-43a8-9050-f6efce01bee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef99771e-67d1-43a8-9050-f6efce01bee7', 'volume_size': 1} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:45 devstack sudo[109765]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf 1073741824" returned: 0 in 0.495s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:45 devstack sudo[109771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf Aug 01 15:19:45 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (db842ae7-b701-433d-a84b-33a2432b3306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f57b286-9818-4ee6-9080-8bf7cce7e1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f57b286-9818-4ee6-9080-8bf7cce7e1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873943093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd33fd7b-7404-4de1-a69a-04a342ba256b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:46Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83cdf83-ab4f-405a-8e45-8e6e276ec028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83cdf83-ab4f-405a-8e45-8e6e276ec028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188f9171-8d9f-4b76-a7bb-ffe85da10698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188f9171-8d9f-4b76-a7bb-ffe85da10698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd33fd7b-7404-4de1-a69a-04a342ba256b', 'volume_name': 'volume-fd33fd7b-7404-4de1-a69a-04a342ba256b', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b532cc-e80e-4a21-8136-9d59c3fee47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b532cc-e80e-4a21-8136-9d59c3fee47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553ac39a-9eff-4a07-ad82-79bfd9bb274e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:45 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume fd33fd7b-7404-4de1-a69a-04a342ba256b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd33fd7b-7404-4de1-a69a-04a342ba256b', 'volume_size': 1} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:45 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf" returned: 0 in 0.315s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.506s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-539252280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef99771e-67d1-43a8-9050-f6efce01bee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:45Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Creating volume ef99771e-67d1-43a8-9050-f6efce01bee7 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:19:45 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:45 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7 1073741824 Aug 01 15:19:45 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f4375a-4d26-4e34-896d-88368e411eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc71fb2-2828-4721-9696-e893214aeedf', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b609066f-4b7d-410a-8b5f-b01ebe5939a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:45 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume volume-5bc71fb2-2828-4721-9696-e893214aeedf (5bc71fb2-2828-4721-9696-e893214aeedf): created successfully Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b609066f-4b7d-410a-8b5f-b01ebe5939a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (60757ff5-67b7-425f-8f73-b203241a7f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-267f0aed-6cf4-438e-b988-11fc54b8c49b tempest-CreateVolumesFromSnapshotTest-627643036 None] Created volume successfully. Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (8435a5ce-09b3-46be-bd3f-494728022cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8b5c00-bf3c-4955-8306-29ea89f9b578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8b5c00-bf3c-4955-8306-29ea89f9b578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1679449520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3b00fb-4ca3-4c98-a52a-ec0d8e62b300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:46Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f726c6a5-dca8-4a28-bd4c-603823c54fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f726c6a5-dca8-4a28-bd4c-603823c54fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46623a88-1ea8-4876-89d2-fddf742e0b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46623a88-1ea8-4876-89d2-fddf742e0b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df3b00fb-4ca3-4c98-a52a-ec0d8e62b300', 'volume_name': 'volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce991f72-dd89-4ac5-ae49-90294f0f1b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce991f72-dd89-4ac5-ae49-90294f0f1b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f209543-e597-40b3-ada3-39e6e30acd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume df3b00fb-4ca3-4c98-a52a-ec0d8e62b300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300', 'volume_size': 1} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:46 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7 1073741824" returned: 0 in 0.523s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:46 devstack sudo[109780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7 Aug 01 15:19:46 devstack sudo[109780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (e5dccdea-fe9e-42b7-8327-bf09069fd04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848a15d9-0d21-4776-a9dd-b22294439d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848a15d9-0d21-4776-a9dd-b22294439d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-178591668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7933ab-2a16-4946-aa44-7aebcc09ee3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:46Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2f1d37-2a08-44ec-8e85-a880e5d7735c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2f1d37-2a08-44ec-8e85-a880e5d7735c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c09299-1e3c-4064-ac19-c8dd7f0213fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c09299-1e3c-4064-ac19-c8dd7f0213fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7933ab-2a16-4946-aa44-7aebcc09ee3c', 'volume_name': 'volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa1412e-1cb5-4584-8ee2-a2d52369adce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa1412e-1cb5-4584-8ee2-a2d52369adce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801f948d-9b5a-4bb6-aa3b-735dfad810cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume 7f7933ab-2a16-4946-aa44-7aebcc09ee3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c', 'volume_size': 1} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:46 devstack sudo[109780]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7" returned: 0 in 0.274s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873943093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd33fd7b-7404-4de1-a69a-04a342ba256b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:46Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Creating volume fd33fd7b-7404-4de1-a69a-04a342ba256b {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:19:46 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:46 devstack sudo[109783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b 1073741824 Aug 01 15:19:46 devstack sudo[109783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8dbb2c9-2b2e-4d4a-8649-79d8ca9b91fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef99771e-67d1-43a8-9050-f6efce01bee7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae28417-07c9-4e7c-a41b-24388bae5fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume volume-ef99771e-67d1-43a8-9050-f6efce01bee7 (ef99771e-67d1-43a8-9050-f6efce01bee7): created successfully Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ae28417-07c9-4e7c-a41b-24388bae5fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (84d2d9e4-8012-4574-b427-dc4ebea06a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:46 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4b4983d9-138f-44b4-9931-056a8a1e3958 tempest-CreateVolumesFromSnapshotTest-627643036 None] Created volume successfully. Aug 01 15:19:47 devstack sudo[109783]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b 1073741824" returned: 0 in 0.405s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:47 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b Aug 01 15:19:47 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:47 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b" returned: 0 in 0.244s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.101s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1679449520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3b00fb-4ca3-4c98-a52a-ec0d8e62b300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:46Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Creating volume df3b00fb-4ca3-4c98-a52a-ec0d8e62b300 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:19:47 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553ac39a-9eff-4a07-ad82-79bfd9bb274e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd33fd7b-7404-4de1-a69a-04a342ba256b', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f1a601-6bc2-44bb-8226-693d318a05bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:47 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300 1073741824 Aug 01 15:19:47 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:47 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume volume-fd33fd7b-7404-4de1-a69a-04a342ba256b (fd33fd7b-7404-4de1-a69a-04a342ba256b): created successfully Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f1a601-6bc2-44bb-8226-693d318a05bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (db842ae7-b701-433d-a84b-33a2432b3306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0feaecf4-6a45-4eae-b28b-8b3a0d16e341 tempest-CreateVolumesFromSnapshotTest-627643036 None] Created volume successfully. Aug 01 15:19:47 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300 1073741824" returned: 0 in 0.409s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:47 devstack sudo[109797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300 Aug 01 15:19:47 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:48 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300" returned: 0 in 0.242s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.507s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-178591668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7933ab-2a16-4946-aa44-7aebcc09ee3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2d1b9c7ed744e6847f7253d92cb3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:19:46Z,use_quota=True,user_id='e9992aa23e734dc496d37edaa63b3f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Creating volume 7f7933ab-2a16-4946-aa44-7aebcc09ee3c {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:19:48 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f209543-e597-40b3-ada3-39e6e30acd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b64544-d5d3-4e7e-adf4-04af2d98a910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:48 devstack sudo[109800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c 1073741824 Aug 01 15:19:48 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:48 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300 (df3b00fb-4ca3-4c98-a52a-ec0d8e62b300): created successfully Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b64544-d5d3-4e7e-adf4-04af2d98a910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (8435a5ce-09b3-46be-bd3f-494728022cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ca3b3c64-85bd-42e4-91b5-cc42450c3702 tempest-CreateVolumesFromSnapshotTest-627643036 None] Created volume successfully. Aug 01 15:19:48 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c 1073741824" returned: 0 in 0.416s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:48 devstack sudo[109806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c Aug 01 15:19:48 devstack sudo[109806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:48 devstack sudo[109806]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c" returned: 0 in 0.238s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801f948d-9b5a-4bb6-aa3b-735dfad810cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbd6355-964d-40fd-95b4-90cf2c4f4105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:19:48 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Volume volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c (7f7933ab-2a16-4946-aa44-7aebcc09ee3c): created successfully Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbd6355-964d-40fd-95b4-90cf2c4f4105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:19:48 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Flow 'volume_create_manager' (e5dccdea-fe9e-42b7-8327-bf09069fd04a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:19:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ec7c4e21-32a8-4182-a92b-e0e88e435ffb tempest-CreateVolumesFromSnapshotTest-627643036 None] Created volume successfully. Aug 01 15:19:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-7f7933ab-2a16-4946-aa44-7aebcc09ee3c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-7f7933ab-2a16-4946-aa44-7aebcc09ee3c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-quobyte-7f7933ab-2a16-4946-aa44-7aebcc09ee3c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-7f7933ab-2a16-4946-aa44-7aebcc09ee3c" acquired by "delete_volume" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:49 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4104fa-68f3-49ea-b24f-f610f76cc99c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:50 devstack sudo[109810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c Aug 01 15:19:50 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:50 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c" returned: 0 in 0.359s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:50 devstack sudo[109815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c Aug 01 15:19:50 devstack sudo[109815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:50 devstack sudo[109815]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f7933ab-2a16-4946-aa44-7aebcc09ee3c" returned: 0 in 0.248s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-7f7933ab-2a16-4946-aa44-7aebcc09ee3c" released by "delete_volume" :: held 0.643s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Created reservations ['66484c93-6d36-4df1-a5d0-1f74e65be8b0', '9b8f4e77-0f54-4475-9866-a3045265495a', '964acd26-165e-491c-8183-a67a2d1e1f7e', '7b3023c2-2bf1-4ae6-a5f4-46b8f08f7ec9'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:50 devstack sudo[109818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:19:50 devstack sudo[109818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:50 devstack sudo[109818]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.238s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:19:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Deleted volume successfully. Aug 01 15:19:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-649b3be5-4577-47f7-b1c6-6d82c3a2b7da tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-7f7933ab-2a16-4946-aa44-7aebcc09ee3c-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-quobyte-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aaa149-8e91-4362-8138-9146789ffc90]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:51 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300 Aug 01 15:19:51 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:51 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300" returned: 0 in 0.351s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:51 devstack sudo[109826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300 Aug 01 15:19:51 devstack sudo[109826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:51 devstack sudo[109826]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300" returned: 0 in 0.250s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300" released by "delete_volume" :: held 0.645s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Created reservations ['3f23c261-7714-4fd7-a4b2-e0c5dee0b26a', '696d9d65-909a-4a06-916d-6318bf3c0c35', '76116f26-0425-42ea-9bcc-15525be3ea2d', '3809cf1d-ddbf-433f-b86a-8dcab07920ee'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:51 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:19:51 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:52 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.246s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:19:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Deleted volume successfully. Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-235c1a4f-4309-40ae-8b81-81f9fe7d0dd2 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-df3b00fb-4ca3-4c98-a52a-ec0d8e62b300-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-fd33fd7b-7404-4de1-a69a-04a342ba256b-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-fd33fd7b-7404-4de1-a69a-04a342ba256b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-quobyte-fd33fd7b-7404-4de1-a69a-04a342ba256b" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-fd33fd7b-7404-4de1-a69a-04a342ba256b" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9818623b-fb52-49e7-93c5-060c40851ba2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:52 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b Aug 01 15:19:52 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:52 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b" returned: 0 in 0.361s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:52 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b Aug 01 15:19:52 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:52 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fd33fd7b-7404-4de1-a69a-04a342ba256b" returned: 0 in 0.238s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-fd33fd7b-7404-4de1-a69a-04a342ba256b" released by "delete_volume" :: held 0.636s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Created reservations ['4fd10116-3ee1-4fb3-9532-c20470ab53ef', '344a3a2b-7344-4d74-a515-4438ecaecffc', '85f3c52c-39db-483b-847a-566216ffc8bf', '1c302699-c469-43b8-9b39-db30da066796'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:53 devstack sudo[109840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:19:53 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:53 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.238s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:53 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:19:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Deleted volume successfully. Aug 01 15:19:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e8b2b73d-0ae5-42db-ba6e-18d5b7fac66b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-fd33fd7b-7404-4de1-a69a-04a342ba256b-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-ef99771e-67d1-43a8-9050-f6efce01bee7-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-ef99771e-67d1-43a8-9050-f6efce01bee7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-quobyte-ef99771e-67d1-43a8-9050-f6efce01bee7" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-ef99771e-67d1-43a8-9050-f6efce01bee7" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:53 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf4512b-8438-4a84-ab97-f249a94f63a9]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:53 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7 Aug 01 15:19:53 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:53 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:53 devstack sudo[109848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7 Aug 01 15:19:53 devstack sudo[109848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:54 devstack sudo[109848]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef99771e-67d1-43a8-9050-f6efce01bee7" returned: 0 in 0.248s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-ef99771e-67d1-43a8-9050-f6efce01bee7" released by "delete_volume" :: held 0.649s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Created reservations ['ee605005-c927-4552-96d4-47b83d6e5a2f', '9a4e29c1-847a-445e-b017-6b7a5eee60c3', '9b09ac8e-6300-4abe-8cd6-939284887402', 'cdba2c56-9986-44cb-96ab-8d1c6c804c68'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:54 devstack sudo[109851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:19:54 devstack sudo[109851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:54 devstack sudo[109851]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.243s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:19:54 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Deleted volume successfully. Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af757984-9c3f-470a-af3f-035c0ad91db7 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-ef99771e-67d1-43a8-9050-f6efce01bee7-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-5bc71fb2-2828-4721-9696-e893214aeedf-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-5bc71fb2-2828-4721-9696-e893214aeedf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-quobyte-5bc71fb2-2828-4721-9696-e893214aeedf" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-5bc71fb2-2828-4721-9696-e893214aeedf" acquired by "delete_volume" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[12800cb4-aca7-4512-b748-0f956be7e908]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:54 devstack sudo[109854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf Aug 01 15:19:54 devstack sudo[109854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:54 devstack sudo[109854]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf" returned: 0 in 0.355s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:54 devstack sudo[109859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf Aug 01 15:19:54 devstack sudo[109859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:55 devstack sudo[109859]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5bc71fb2-2828-4721-9696-e893214aeedf" returned: 0 in 0.235s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-5bc71fb2-2828-4721-9696-e893214aeedf" released by "delete_volume" :: held 0.626s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Created reservations ['002c26a4-e26f-4c60-9a35-c16899fcbe60', '86d75249-1c44-4807-ab78-3032ff6e00f2', '98778cd8-5beb-4c55-8d02-0d44c06c345d', 'c3a8803b-ac63-411c-a93d-58b97ba024c2'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:55 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:19:55 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:55 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.243s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:19:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Deleted volume successfully. Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0e4f380-981e-42d1-a176-a82664dd3f7b tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-5bc71fb2-2828-4721-9696-e893214aeedf-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-80a73953-4466-4b25-b9b0-964d914ac001-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-80a73953-4466-4b25-b9b0-964d914ac001-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-quobyte-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-quobyte-80a73953-4466-4b25-b9b0-964d914ac001" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-80a73953-4466-4b25-b9b0-964d914ac001" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Deleting offline snapshot 80a73953-4466-4b25-b9b0-964d914ac001 of volume 4b48e802-5a32-4eb7-81d3-8a80c8c8d92c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] snapshot_file for this snap is: volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e438def-1b19-4dcd-b8b4-5b4ad221f970]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:55 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 Aug 01 15:19:55 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:56 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001" returned: 0 in 0.340s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:19:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc0c4f6-01ca-4838-b74d-49d76d5e3ad4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:56 devstack sudo[109870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c Aug 01 15:19:56 devstack sudo[109870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:56 devstack sudo[109870]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c" returned: 0 in 0.345s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:56 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 Aug 01 15:19:56 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:56 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001" returned: 0 in 0.331s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:56 devstack sudo[109880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001 Aug 01 15:19:56 devstack sudo[109880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:57 devstack sudo[109880]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c.80a73953-4466-4b25-b9b0-964d914ac001" returned: 0 in 0.254s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-80a73953-4466-4b25-b9b0-964d914ac001" released by "_delete_snapshot" :: held 1.364s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c" released by "delete_snapshot" :: held 1.390s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:57 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Created reservations ['e73bef23-1f99-4bb6-9c65-78465d204d27', 'f92f5a50-d303-4176-b2f8-cd4f76704859', 'c5f4a49f-38b3-46cd-98bf-ca2c34eaf5e7', '932763fe-da56-4a2a-8271-c015180f5afb'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:19:57 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Delete snapshot completed successfully. Aug 01 15:19:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a0a0a808-0e6e-4b57-be17-f5b47da15f34 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-80a73953-4466-4b25-b9b0-964d914ac001-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "cinder-quobyte-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:19:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:19:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[82433bbc-6b41-40d7-a418-17ee5bbb0d0a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:19:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:58 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c Aug 01 15:19:58 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:58 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c" returned: 0 in 0.353s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:58 devstack sudo[109888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c Aug 01 15:19:58 devstack sudo[109888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:58 devstack sudo[109888]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c" returned: 0 in 0.251s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-quobyte-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c" released by "delete_volume" :: held 0.660s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Created reservations ['bf547a96-c943-4753-b13b-4d8f2ee1f95b', '720dede5-6ae1-4f2e-86fe-7e850d24b549', 'cd0d6501-5e1f-48d3-9ddb-a1448c6fdfb9', 'ff3e3df8-5ef4-4e16-80b2-40d7fd107393'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:19:58 devstack sudo[109891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:19:58 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:19:58 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.242s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:19:58 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Deleted volume successfully. Aug 01 15:19:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2003303e-7cc4-4f06-a0ce-8356db6ec3c4 tempest-CreateVolumesFromSnapshotTest-627643036 None] Lock "cinder-4b48e802-5a32-4eb7-81d3-8a80c8c8d92c-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:20:08 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=58,cinder:INSERT=17,cinder:UPDATE=87,cinder:DELETE=7 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:20:08 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=56,cinder:UPDATE=75,cinder:INSERT=22,cinder:DELETE=7 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:20:18 devstack sudo[109904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:20:18 devstack sudo[109904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:20:18 devstack sudo[109904]: pam_unix(sudo:session): session closed for user root Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.299s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:20:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Flow 'volume_create_manager' (9fb6c4ed-edb9-433b-8308-803c38104855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640ba300-3aa4-41bb-ace5-25cd04e730bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640ba300-3aa4-41bb-ace5-25cd04e730bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1963842570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95b90dd-8e75-4ad0-a245-6127fe609009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfbf30d3dd4e1b9440e091c83e50a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:20:56Z,use_quota=True,user_id='636b1269521143bb8dda79a46c1bab57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee153ae3-e716-440d-819a-b47ef4816091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee153ae3-e716-440d-819a-b47ef4816091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428f70ce-3141-45cc-b4db-cb3d0116c192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428f70ce-3141-45cc-b4db-cb3d0116c192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a95b90dd-8e75-4ad0-a245-6127fe609009', 'volume_name': 'volume-a95b90dd-8e75-4ad0-a245-6127fe609009', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e74b139-e68b-414e-ad57-0ffd439c95b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e74b139-e68b-414e-ad57-0ffd439c95b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280f2daa-e162-416e-b860-a1897d23ae45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:20:56 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Volume a95b90dd-8e75-4ad0-a245-6127fe609009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a95b90dd-8e75-4ad0-a245-6127fe609009', 'volume_size': 1} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1963842570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95b90dd-8e75-4ad0-a245-6127fe609009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfbf30d3dd4e1b9440e091c83e50a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:20:56Z,use_quota=True,user_id='636b1269521143bb8dda79a46c1bab57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Creating volume a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:20:56 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:20:56 devstack sudo[110078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 1073741824 Aug 01 15:20:56 devstack sudo[110078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:20:56 devstack sudo[110078]: pam_unix(sudo:session): session closed for user root Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 1073741824" returned: 0 in 0.397s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:20:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:20:56 devstack sudo[110084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 Aug 01 15:20:56 devstack sudo[110084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:20:57 devstack sudo[110084]: pam_unix(sudo:session): session closed for user root Aug 01 15:20:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009" returned: 0 in 0.241s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:20:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:20:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:20:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280f2daa-e162-416e-b860-a1897d23ae45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95b90dd-8e75-4ad0-a245-6127fe609009', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:20:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9617d97d-d974-4016-92e7-747634ce2ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:20:57 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Volume volume-a95b90dd-8e75-4ad0-a245-6127fe609009 (a95b90dd-8e75-4ad0-a245-6127fe609009): created successfully Aug 01 15:20:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9617d97d-d974-4016-92e7-747634ce2ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:20:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Flow 'volume_create_manager' (9fb6c4ed-edb9-433b-8308-803c38104855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:20:57 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e981bceb-0e09-4685-bc8d-78d7cfdb9ee3 tempest-SnapshotDataIntegrityTests-1545401310 None] Created volume successfully. Aug 01 15:20:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-ee42a39f-6a35-4466-958e-ee789c69d6ed req-02b5e6d3-ff73-4464-ae0a-30a4cc58c139 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:20:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-ee42a39f-6a35-4466-958e-ee789c69d6ed req-02b5e6d3-ff73-4464-ae0a-30a4cc58c139 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:20:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-ee42a39f-6a35-4466-958e-ee789c69d6ed req-02b5e6d3-ff73-4464-ae0a-30a4cc58c139 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:20:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-ee42a39f-6a35-4466-958e-ee789c69d6ed req-02b5e6d3-ff73-4464-ae0a-30a4cc58c139 tempest-SnapshotDataIntegrityTests-1545401310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-a95b90dd-8e75-4ad0-a245-6127fe609009', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0be283e5-acba-442b-a56f-afd52e1af0a5', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:20:58 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-ee42a39f-6a35-4466-958e-ee789c69d6ed req-02b5e6d3-ff73-4464-ae0a-30a4cc58c139 tempest-SnapshotDataIntegrityTests-1545401310 None] attachment_update completed successfully. Aug 01 15:21:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:21:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:21:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Creating online snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 of volume a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:21:01 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9c64c5-5b6d-452b-bfd4-7ed4606a0e8b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:21:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:01 devstack sudo[110516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 Aug 01 15:21:01 devstack sudo[110516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:02 devstack sudo[110516]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009" returned: 0 in 0.364s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:02 devstack sudo[110521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 1G Aug 01 15:21:02 devstack sudo[110521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:02 devstack sudo[110521]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 1G" returned: 0 in 0.367s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b90dd-8e75-4ad0-a245-6127fe609009 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:02 devstack sudo[110527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b90dd-8e75-4ad0-a245-6127fe609009 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 Aug 01 15:21:02 devstack sudo[110527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:02 devstack sudo[110527]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b90dd-8e75-4ad0-a245-6127fe609009 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4" returned: 0 in 0.289s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:02 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 is being set with open permissions: ugo+rw Aug 01 15:21:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:02 devstack sudo[110532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 Aug 01 15:21:02 devstack sudo[110532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:02 devstack sudo[110532]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4" returned: 0 in 0.235s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:02 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:21:03 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] REQ: curl -g -i -X POST http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}d56771305c4a986bd580318850bebe8a45761257babb543a1ac53583a464f2d5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b4ad7ce4-37e8-4b15-84fe-844ee5484581" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" -d '{"snapshot": {"volume_id": "a95b90dd-8e75-4ad0-a245-6127fe609009", "create_info": {"type": "qcow2", "new_file": "volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4", "snapshot_id": "367d2e15-dd20-40ce-9256-2408e65b4be4"}}}' {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:21:03 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Sat, 01 Aug 2026 13:21:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e4b208e5-1e76-4d46-a68f-d2907153ceac x-openstack-request-id: req-e4b208e5-1e76-4d46-a68f-d2907153ceac {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:21:03 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "a95b90dd-8e75-4ad0-a245-6127fe609009"}} {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 01 15:21:03 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] POST call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots used request id req-e4b208e5-1e76-4d46-a68f-d2907153ceac {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:21:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] nova call result: None {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 01 15:21:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:18 devstack sudo[110549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.info Aug 01 15:21:18 devstack sudo[110549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:18 devstack sudo[110554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:21:18 devstack sudo[110554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:18 devstack sudo[110549]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.info" returned: 0 in 0.298s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:18 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.info is being set with open permissions: ugo+rw Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:18 devstack sudo[110557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.info Aug 01 15:21:18 devstack sudo[110557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:18 devstack sudo[110554]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.300s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:21:18 devstack sudo[110557]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.info" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 17.329s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:21:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b4ad7ce4-37e8-4b15-84fe-844ee5484581 tempest-SnapshotDataIntegrityTests-1545401310 None] Create snapshot completed successfully Aug 01 15:21:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:21:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:21:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Creating online snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e of volume a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:21:20 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae629e2-7210-482d-b2d3-5d5ae3d39a55]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:21:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:20 devstack sudo[110632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 Aug 01 15:21:20 devstack sudo[110632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:20 devstack sudo[110632]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4" returned: 0 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:21:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:20 devstack sudo[110637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e 1G Aug 01 15:21:20 devstack sudo[110637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:20 devstack sudo[110637]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e 1G" returned: 0 in 0.403s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:20 devstack sudo[110642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e Aug 01 15:21:20 devstack sudo[110642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:21 devstack sudo[110642]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e" returned: 0 in 0.275s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:21 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e is being set with open permissions: ugo+rw Aug 01 15:21:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:21 devstack sudo[110647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e Aug 01 15:21:21 devstack sudo[110647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:21 devstack sudo[110647]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e" returned: 0 in 0.241s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:21 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:21:21 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] REQ: curl -g -i -X POST http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8dcc35780ba6a97e076acc71f801601998860e7d4d7af96ef1ea0febe4bcb4b0" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d5d2e58-8061-4db5-a34c-5c78d88b7602" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" -d '{"snapshot": {"volume_id": "a95b90dd-8e75-4ad0-a245-6127fe609009", "create_info": {"type": "qcow2", "new_file": "volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e", "snapshot_id": "b2e123fe-9b41-41fe-8a4b-edbd6731c00e"}}}' {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:21:21 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Sat, 01 Aug 2026 13:21:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ec9ae1fc-6727-4d6a-9950-539f957e08a9 x-openstack-request-id: req-ec9ae1fc-6727-4d6a-9950-539f957e08a9 {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:21:21 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "a95b90dd-8e75-4ad0-a245-6127fe609009"}} {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 01 15:21:21 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] POST call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots used request id req-ec9ae1fc-6727-4d6a-9950-539f957e08a9 {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:21:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] nova call result: None {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 01 15:21:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 16.683s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:21:36 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0d5d2e58-8061-4db5-a34c-5c78d88b7602 tempest-SnapshotDataIntegrityTests-1545401310 None] Create snapshot completed successfully Aug 01 15:21:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:21:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:21:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Creating online snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 of volume a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:21:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4744f8-c25f-4461-8d1d-522ce4af2060]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:21:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:38 devstack sudo[110676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e Aug 01 15:21:38 devstack sudo[110676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:38 devstack sudo[110676]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e" returned: 0 in 0.360s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:21:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:38 devstack sudo[110681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 1G Aug 01 15:21:38 devstack sudo[110681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:39 devstack sudo[110681]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 1G" returned: 0 in 0.444s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:39 devstack sudo[110686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 Aug 01 15:21:39 devstack sudo[110686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:39 devstack sudo[110686]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4" returned: 0 in 0.309s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:39 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 is being set with open permissions: ugo+rw Aug 01 15:21:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:39 devstack sudo[110692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 Aug 01 15:21:39 devstack sudo[110692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:39 devstack sudo[110692]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:39 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:21:40 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] REQ: curl -g -i -X POST http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}7f3769391e17e4f38f7095707b6436318f28e470dc4664d41840b5619a7ea7e2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0578964-9179-4b1c-9506-f7947948cb4f" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" -d '{"snapshot": {"volume_id": "a95b90dd-8e75-4ad0-a245-6127fe609009", "create_info": {"type": "qcow2", "new_file": "volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4", "snapshot_id": "a87db855-69aa-44a9-bb5f-66b3540d8bf4"}}}' {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:21:40 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Sat, 01 Aug 2026 13:21:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b66479f3-40b4-43ba-afe3-75ce1faa2e44 x-openstack-request-id: req-b66479f3-40b4-43ba-afe3-75ce1faa2e44 {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:21:40 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "a95b90dd-8e75-4ad0-a245-6127fe609009"}} {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 01 15:21:40 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] POST call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots used request id req-b66479f3-40b4-43ba-afe3-75ce1faa2e44 {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:21:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] nova call result: None {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 01 15:21:40 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=11,cinder:SELECT=32,cinder:INSERT=2 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:21:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:41 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=33,cinder:UPDATE=7,cinder:DELETE=3 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:21:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Status of snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:21:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 16.777s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:21:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d0578964-9179-4b1c-9506-f7947948cb4f tempest-SnapshotDataIntegrityTests-1545401310 None] Create snapshot completed successfully Aug 01 15:21:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-53e035a8-78bd-4251-89f7-773f59e67850 req-a706940e-2548-4b3f-bb7a-8829b7c0be1d tempest-SnapshotDataIntegrityTests-1545401310 None] Terminate volume connection completed successfully. Aug 01 15:21:56 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-53e035a8-78bd-4251-89f7-773f59e67850 req-a706940e-2548-4b3f-bb7a-8829b7c0be1d tempest-SnapshotDataIntegrityTests-1545401310 None] Deleting attachment 0be283e5-acba-442b-a56f-afd52e1af0a5. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:21:57 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:21:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Flow 'volume_create_manager' (3aa4aa34-1750-439e-ad88-0bced6508568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:21:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e0a32b-553e-4217-8eee-f3c5b98be57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:21:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e0a32b-553e-4217-8eee-f3c5b98be57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-2019524944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3325f49-025d-453d-9bd2-fb0316ea3656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfbf30d3dd4e1b9440e091c83e50a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=367d2e15-dd20-40ce-9256-2408e65b4be4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:21:58Z,use_quota=True,user_id='636b1269521143bb8dda79a46c1bab57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:21:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e963ef-21cb-4840-8eab-23d1040ccee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e963ef-21cb-4840-8eab-23d1040ccee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b070bb50-9327-47ff-8ddd-dcc58c33e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b070bb50-9327-47ff-8ddd-dcc58c33e48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3325f49-025d-453d-9bd2-fb0316ea3656', 'volume_name': 'volume-d3325f49-025d-453d-9bd2-fb0316ea3656', 'volume_size': 1, 'snapshot_id': '367d2e15-dd20-40ce-9256-2408e65b4be4'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bff305-04e6-4332-8b76-82c586bcf6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8bff305-04e6-4332-8b76-82c586bcf6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45071aa-b2ab-4d37-8f2c-19bc9ab1e4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:21:58 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Volume d3325f49-025d-453d-9bd2-fb0316ea3656: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3325f49-025d-453d-9bd2-fb0316ea3656', 'volume_size': 1, 'snapshot_id': '367d2e15-dd20-40ce-9256-2408e65b4be4'} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-367d2e15-dd20-40ce-9256-2408e65b4be4-d3325f49-025d-453d-9bd2-fb0316ea3656" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-367d2e15-dd20-40ce-9256-2408e65b4be4-d3325f49-025d-453d-9bd2-fb0316ea3656" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Creating volume d3325f49-025d-453d-9bd2-fb0316ea3656 from snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-d3325f49-025d-453d-9bd2-fb0316ea3656" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-d3325f49-025d-453d-9bd2-fb0316ea3656" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] snapshot: 367d2e15-dd20-40ce-9256-2408e65b4be4, volume: d3325f49-025d-453d-9bd2-fb0316ea3656, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ea871-1422-44b8-b374-b840ce576291]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:58 devstack sudo[110710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 Aug 01 15:21:58 devstack sudo[110710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:58 devstack sudo[110710]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4" returned: 0 in 0.354s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0705320-9635-40b7-9fd5-21a5e0ffc384]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:58 devstack sudo[110716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 Aug 01 15:21:58 devstack sudo[110716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:21:58 devstack sudo[110716]: pam_unix(sudo:session): session closed for user root Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009" returned: 0 in 0.369s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:21:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:21:58 devstack sudo[110721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656 Aug 01 15:21:58 devstack sudo[110721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:02 devstack sudo[110721]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656" returned: 0 in 4.003s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:02 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:22:02 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Converted 1024.00 MB image at 255.72 MB/s Aug 01 15:22:02 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656 is being set with open permissions: ugo+rw Aug 01 15:22:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:02 devstack sudo[110735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656 Aug 01 15:22:02 devstack sudo[110735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:03 devstack sudo[110735]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656" returned: 0 in 0.238s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-d3325f49-025d-453d-9bd2-fb0316ea3656" released by "_copy_volume_from_snapshot" :: held 5.042s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-367d2e15-dd20-40ce-9256-2408e65b4be4-d3325f49-025d-453d-9bd2-fb0316ea3656" released by "_create_volume_from_snapshot" :: held 5.102s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.119s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45071aa-b2ab-4d37-8f2c-19bc9ab1e4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3325f49-025d-453d-9bd2-fb0316ea3656', 'volume_size': 1, 'snapshot_id': '367d2e15-dd20-40ce-9256-2408e65b4be4'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90491ac9-c05a-45ed-9636-ed0f50b45635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Volume volume-d3325f49-025d-453d-9bd2-fb0316ea3656 (d3325f49-025d-453d-9bd2-fb0316ea3656): created successfully Aug 01 15:22:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90491ac9-c05a-45ed-9636-ed0f50b45635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Flow 'volume_create_manager' (3aa4aa34-1750-439e-ad88-0bced6508568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:22:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-aad1ed35-ec77-4d6c-bc8a-560fd4934a19 tempest-SnapshotDataIntegrityTests-1545401310 None] Created volume successfully. Aug 01 15:22:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-4626fe66-a753-4cc4-8725-72e9898d058d req-fa27d8e9-9d2e-428d-8a1c-ff1999a8dfa2 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-4626fe66-a753-4cc4-8725-72e9898d058d req-fa27d8e9-9d2e-428d-8a1c-ff1999a8dfa2 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-4626fe66-a753-4cc4-8725-72e9898d058d req-fa27d8e9-9d2e-428d-8a1c-ff1999a8dfa2 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-4626fe66-a753-4cc4-8725-72e9898d058d req-fa27d8e9-9d2e-428d-8a1c-ff1999a8dfa2 tempest-SnapshotDataIntegrityTests-1545401310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-d3325f49-025d-453d-9bd2-fb0316ea3656', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c49f33ed-f8df-4db8-aed5-994e11911bb3', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:22:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-4626fe66-a753-4cc4-8725-72e9898d058d req-fa27d8e9-9d2e-428d-8a1c-ff1999a8dfa2 tempest-SnapshotDataIntegrityTests-1545401310 None] attachment_update completed successfully. Aug 01 15:22:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-7201ba61-6fb1-4601-998e-ea1b4f4d6dc0 req-68845a8d-684c-420b-bbc4-1801885d21d3 tempest-SnapshotDataIntegrityTests-1545401310 None] Terminate volume connection completed successfully. Aug 01 15:22:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-7201ba61-6fb1-4601-998e-ea1b4f4d6dc0 req-68845a8d-684c-420b-bbc4-1801885d21d3 tempest-SnapshotDataIntegrityTests-1545401310 None] Deleting attachment c49f33ed-f8df-4db8-aed5-994e11911bb3. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Flow 'volume_create_manager' (63853487-6264-40d0-a24e-68b50eba2865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b719b031-abb9-46ea-84cd-5ed1ded5e56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b719b031-abb9-46ea-84cd-5ed1ded5e56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-300157405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4122eac3-907b-4372-beed-e68a38064561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfbf30d3dd4e1b9440e091c83e50a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b2e123fe-9b41-41fe-8a4b-edbd6731c00e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:22:09Z,use_quota=True,user_id='636b1269521143bb8dda79a46c1bab57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586e349e-51cc-4012-9b80-2b21e429d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586e349e-51cc-4012-9b80-2b21e429d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f355c3-556b-4328-a338-e913b94359ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f355c3-556b-4328-a338-e913b94359ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4122eac3-907b-4372-beed-e68a38064561', 'volume_name': 'volume-4122eac3-907b-4372-beed-e68a38064561', 'volume_size': 1, 'snapshot_id': 'b2e123fe-9b41-41fe-8a4b-edbd6731c00e'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc458333-35a6-4ccc-8699-440b4972be6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc458333-35a6-4ccc-8699-440b4972be6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ae9ac9-9648-4878-aa7a-8ce5dd90aaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:09 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Volume 4122eac3-907b-4372-beed-e68a38064561: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4122eac3-907b-4372-beed-e68a38064561', 'volume_size': 1, 'snapshot_id': 'b2e123fe-9b41-41fe-8a4b-edbd6731c00e'} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-b2e123fe-9b41-41fe-8a4b-edbd6731c00e-4122eac3-907b-4372-beed-e68a38064561" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-b2e123fe-9b41-41fe-8a4b-edbd6731c00e-4122eac3-907b-4372-beed-e68a38064561" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Creating volume 4122eac3-907b-4372-beed-e68a38064561 from snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-4122eac3-907b-4372-beed-e68a38064561" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-4122eac3-907b-4372-beed-e68a38064561" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] snapshot: b2e123fe-9b41-41fe-8a4b-edbd6731c00e, volume: 4122eac3-907b-4372-beed-e68a38064561, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a273a5-25cb-40c0-9ab6-ae7f6e54bf62]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:09 devstack sudo[111198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e Aug 01 15:22:09 devstack sudo[111198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:09 devstack sudo[111198]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e" returned: 0 in 0.345s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e973982-9d36-41ff-8d9f-a3fead04c792]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:09 devstack sudo[111203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 Aug 01 15:22:09 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:10 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:22:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:22:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:22:10 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:22:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:10 devstack sudo[111209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561 Aug 01 15:22:10 devstack sudo[111209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:14 devstack sudo[111209]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561" returned: 0 in 4.124s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:14 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4, size 1024.00 MB, duration 4.13 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:22:14 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Converted 1024.00 MB image at 248.21 MB/s Aug 01 15:22:14 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561 is being set with open permissions: ugo+rw Aug 01 15:22:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:14 devstack sudo[111222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561 Aug 01 15:22:14 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:14 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561" returned: 0 in 0.244s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-4122eac3-907b-4372-beed-e68a38064561" released by "_copy_volume_from_snapshot" :: held 5.139s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-b2e123fe-9b41-41fe-8a4b-edbd6731c00e-4122eac3-907b-4372-beed-e68a38064561" released by "_create_volume_from_snapshot" :: held 5.196s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.210s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ae9ac9-9648-4878-aa7a-8ce5dd90aaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4122eac3-907b-4372-beed-e68a38064561', 'volume_size': 1, 'snapshot_id': 'b2e123fe-9b41-41fe-8a4b-edbd6731c00e'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fe71bf-5afe-496a-8f38-06e781c46ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:14 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Volume volume-4122eac3-907b-4372-beed-e68a38064561 (4122eac3-907b-4372-beed-e68a38064561): created successfully Aug 01 15:22:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fe71bf-5afe-496a-8f38-06e781c46ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:14 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Flow 'volume_create_manager' (63853487-6264-40d0-a24e-68b50eba2865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:22:14 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-099268e6-0f7c-42af-8bcf-7a7bdc3d3447 tempest-SnapshotDataIntegrityTests-1545401310 None] Created volume successfully. Aug 01 15:22:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6ac9247e-4dc7-42fd-bdd4-fcd5e6f1e1cf req-67a021b6-9ca6-4728-9622-63f2b7b2a998 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6ac9247e-4dc7-42fd-bdd4-fcd5e6f1e1cf req-67a021b6-9ca6-4728-9622-63f2b7b2a998 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-6ac9247e-4dc7-42fd-bdd4-fcd5e6f1e1cf req-67a021b6-9ca6-4728-9622-63f2b7b2a998 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-6ac9247e-4dc7-42fd-bdd4-fcd5e6f1e1cf req-67a021b6-9ca6-4728-9622-63f2b7b2a998 tempest-SnapshotDataIntegrityTests-1545401310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-4122eac3-907b-4372-beed-e68a38064561', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9cd2259-e0c7-4c4a-9947-8458d6a59958', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:22:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-6ac9247e-4dc7-42fd-bdd4-fcd5e6f1e1cf req-67a021b6-9ca6-4728-9622-63f2b7b2a998 tempest-SnapshotDataIntegrityTests-1545401310 None] attachment_update completed successfully. Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:18 devstack sudo[111648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:22:18 devstack sudo[111648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:18 devstack sudo[111648]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.263s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:22:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:22:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-a94ab906-2b8d-4b34-a2ae-55a3ba6001fe req-1805d28e-a631-404f-878d-fd8ad831095c tempest-SnapshotDataIntegrityTests-1545401310 None] Terminate volume connection completed successfully. Aug 01 15:22:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-a94ab906-2b8d-4b34-a2ae-55a3ba6001fe req-1805d28e-a631-404f-878d-fd8ad831095c tempest-SnapshotDataIntegrityTests-1545401310 None] Deleting attachment f9cd2259-e0c7-4c4a-9947-8458d6a59958. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Flow 'volume_create_manager' (fbcfbd7f-b4bb-4bc9-b033-e2925182a7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831b10e8-91e2-489e-9634-38bfd097cdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831b10e8-91e2-489e-9634-38bfd097cdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-545773735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52ed60e-3e0a-4722-a1a7-c9bad840db7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfbf30d3dd4e1b9440e091c83e50a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a87db855-69aa-44a9-bb5f-66b3540d8bf4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:22:20Z,use_quota=True,user_id='636b1269521143bb8dda79a46c1bab57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cded4f-e321-42c9-ba65-2a819bc78610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12cded4f-e321-42c9-ba65-2a819bc78610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8ddef3-485b-46d0-ac1b-89f431181cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8ddef3-485b-46d0-ac1b-89f431181cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd52ed60e-3e0a-4722-a1a7-c9bad840db7c', 'volume_name': 'volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c', 'volume_size': 1, 'snapshot_id': 'a87db855-69aa-44a9-bb5f-66b3540d8bf4'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c5f7aa-6657-48a5-87f5-25baf651fd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c5f7aa-6657-48a5-87f5-25baf651fd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d52dfe-53dc-4d6d-a15e-5eaab70833d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:20 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Volume d52ed60e-3e0a-4722-a1a7-c9bad840db7c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c', 'volume_size': 1, 'snapshot_id': 'a87db855-69aa-44a9-bb5f-66b3540d8bf4'} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-a87db855-69aa-44a9-bb5f-66b3540d8bf4-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a87db855-69aa-44a9-bb5f-66b3540d8bf4-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Creating volume d52ed60e-3e0a-4722-a1a7-c9bad840db7c from snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] snapshot: a87db855-69aa-44a9-bb5f-66b3540d8bf4, volume: d52ed60e-3e0a-4722-a1a7-c9bad840db7c, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[528a7c2f-f8e5-4107-ae86-61f712b03255]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:20 devstack sudo[111718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 Aug 01 15:22:20 devstack sudo[111718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:20 devstack sudo[111718]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4" returned: 0 in 0.351s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e4ad81-08ea-4963-a7b6-3165e8b8ac15]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:21 devstack sudo[111723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e Aug 01 15:22:21 devstack sudo[111723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:21 devstack sudo[111723]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e" returned: 0 in 0.367s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:22:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:22:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:22:21 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:22:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:21 devstack sudo[111728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c Aug 01 15:22:21 devstack sudo[111728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:25 devstack sudo[111728]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" returned: 0 in 4.242s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:25 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e, size 1024.00 MB, duration 4.24 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:22:25 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Converted 1024.00 MB image at 241.34 MB/s Aug 01 15:22:25 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c is being set with open permissions: ugo+rw Aug 01 15:22:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:25 devstack sudo[111747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c Aug 01 15:22:25 devstack sudo[111747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:25 devstack sudo[111747]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" returned: 0 in 0.246s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" released by "_copy_volume_from_snapshot" :: held 5.280s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a87db855-69aa-44a9-bb5f-66b3540d8bf4-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" released by "_create_volume_from_snapshot" :: held 5.341s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.355s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d52dfe-53dc-4d6d-a15e-5eaab70833d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c', 'volume_size': 1, 'snapshot_id': 'a87db855-69aa-44a9-bb5f-66b3540d8bf4'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632fe470-0d23-4dcd-a116-62b5edcb1906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:22:25 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Volume volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c (d52ed60e-3e0a-4722-a1a7-c9bad840db7c): created successfully Aug 01 15:22:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632fe470-0d23-4dcd-a116-62b5edcb1906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:22:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Flow 'volume_create_manager' (fbcfbd7f-b4bb-4bc9-b033-e2925182a7b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:22:25 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-dfd655b5-57e2-4b62-940b-78d9d8c3c7be tempest-SnapshotDataIntegrityTests-1545401310 None] Created volume successfully. Aug 01 15:22:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-3521e68f-61da-410a-b576-6ee572230e9c req-46df5dce-2a30-40d5-bb26-7b80af603443 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-3521e68f-61da-410a-b576-6ee572230e9c req-46df5dce-2a30-40d5-bb26-7b80af603443 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-3521e68f-61da-410a-b576-6ee572230e9c req-46df5dce-2a30-40d5-bb26-7b80af603443 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-3521e68f-61da-410a-b576-6ee572230e9c req-46df5dce-2a30-40d5-bb26-7b80af603443 tempest-SnapshotDataIntegrityTests-1545401310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5b764fd-89ce-4aee-b30e-3006870ea70a', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:22:27 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-3521e68f-61da-410a-b576-6ee572230e9c req-46df5dce-2a30-40d5-bb26-7b80af603443 tempest-SnapshotDataIntegrityTests-1545401310 None] attachment_update completed successfully. Aug 01 15:22:31 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-0c44604b-cedc-4c92-85f6-9b7b58f05207 req-bc1fff31-7a66-4d4a-a91f-c33951e5d612 tempest-SnapshotDataIntegrityTests-1545401310 None] Terminate volume connection completed successfully. Aug 01 15:22:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-0c44604b-cedc-4c92-85f6-9b7b58f05207 req-bc1fff31-7a66-4d4a-a91f-c33951e5d612 tempest-SnapshotDataIntegrityTests-1545401310 None] Deleting attachment c5b764fd-89ce-4aee-b30e-3006870ea70a. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-d52ed60e-3e0a-4722-a1a7-c9bad840db7c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-d52ed60e-3e0a-4722-a1a7-c9bad840db7c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98d9e3e-4634-42e5-bd1b-de33594e3181]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:32 devstack sudo[112206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c Aug 01 15:22:32 devstack sudo[112206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:32 devstack sudo[112206]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:32 devstack sudo[112211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c Aug 01 15:22:32 devstack sudo[112211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:32 devstack sudo[112211]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" returned: 0 in 0.243s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-d52ed60e-3e0a-4722-a1a7-c9bad840db7c" released by "delete_volume" :: held 0.631s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Created reservations ['f1972c80-8717-4007-9e81-ebab9a011bca', '513a1a77-39f8-41e8-9ffe-aa35ce73c645', '94e4183d-c4ef-4922-8305-94949d8307b3', '65fa9a77-49b4-4c0b-b75a-82e8624e8097'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:32 devstack sudo[112214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:22:32 devstack sudo[112214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:33 devstack sudo[112214]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.235s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:33 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:22:33 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Deleted volume successfully. Aug 01 15:22:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8bb98360-8dbf-45da-af17-8ad8e646ff66 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-d52ed60e-3e0a-4722-a1a7-c9bad840db7c-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-4122eac3-907b-4372-beed-e68a38064561-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-4122eac3-907b-4372-beed-e68a38064561-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-4122eac3-907b-4372-beed-e68a38064561" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-4122eac3-907b-4372-beed-e68a38064561" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:33 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe10e294-c8a6-4695-be06-237001ce0802]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:33 devstack sudo[112217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561 Aug 01 15:22:33 devstack sudo[112217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:33 devstack sudo[112217]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561" returned: 0 in 0.343s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:33 devstack sudo[112222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561 Aug 01 15:22:33 devstack sudo[112222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:34 devstack sudo[112222]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-4122eac3-907b-4372-beed-e68a38064561" returned: 0 in 0.237s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-4122eac3-907b-4372-beed-e68a38064561" released by "delete_volume" :: held 0.620s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Created reservations ['c19c696c-baaf-4788-ba80-182cdd1f17fd', '318a34df-20be-4fe6-a85e-f010b72a6c73', 'd1dcb36f-2f7a-4773-8ab5-297778567ecc', '6cdc355e-67c4-4c62-8aa7-5f529b201ce6'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:34 devstack sudo[112225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:22:34 devstack sudo[112225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:34 devstack sudo[112225]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.242s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:22:34 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Deleted volume successfully. Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-777d036e-fd54-47ec-862b-65ad93dec601 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-4122eac3-907b-4372-beed-e68a38064561-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-d3325f49-025d-453d-9bd2-fb0316ea3656-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-d3325f49-025d-453d-9bd2-fb0316ea3656-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-d3325f49-025d-453d-9bd2-fb0316ea3656" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-d3325f49-025d-453d-9bd2-fb0316ea3656" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd793ed-a27e-4f62-be03-cc2044fc6764]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:34 devstack sudo[112228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656 Aug 01 15:22:34 devstack sudo[112228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:35 devstack sudo[112228]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:35 devstack sudo[112233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656 Aug 01 15:22:35 devstack sudo[112233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:35 devstack sudo[112233]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d3325f49-025d-453d-9bd2-fb0316ea3656" returned: 0 in 0.242s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-d3325f49-025d-453d-9bd2-fb0316ea3656" released by "delete_volume" :: held 0.631s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Created reservations ['bff5231e-f0aa-417a-a38b-19b4a1f1c2b8', 'daadf942-3080-40d3-8d83-11331a3581a0', '19ee4fcc-371d-4cfa-9605-557894bd3294', '690e8b10-1d45-42a2-bcae-d90172693252'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:35 devstack sudo[112236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:22:35 devstack sudo[112236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:35 devstack sudo[112236]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.247s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:22:35 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Deleted volume successfully. Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb36b49a-a973-4afd-ba70-cbc74a879be6 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-d3325f49-025d-453d-9bd2-fb0316ea3656-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-a87db855-69aa-44a9-bb5f-66b3540d8bf4-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-a87db855-69aa-44a9-bb5f-66b3540d8bf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-a87db855-69aa-44a9-bb5f-66b3540d8bf4" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a87db855-69aa-44a9-bb5f-66b3540d8bf4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Deleting offline snapshot a87db855-69aa-44a9-bb5f-66b3540d8bf4 of volume a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] snapshot_file for this snap is: volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4549540f-e5ee-4831-bf0b-a51099a888df]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:36 devstack sudo[112239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 Aug 01 15:22:36 devstack sudo[112239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:36 devstack sudo[112239]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4" returned: 0 in 0.349s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:22:36 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[678ce3c0-7ec4-4c58-80b5-a30fd3d69a45]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:36 devstack sudo[112244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e Aug 01 15:22:36 devstack sudo[112244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:36 devstack sudo[112244]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e" returned: 0 in 0.346s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:22:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:36 devstack sudo[112249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 Aug 01 15:22:36 devstack sudo[112249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:37 devstack sudo[112249]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4" returned: 0 in 0.567s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:37 devstack sudo[112255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4 Aug 01 15:22:37 devstack sudo[112255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:37 devstack sudo[112255]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.a87db855-69aa-44a9-bb5f-66b3540d8bf4" returned: 0 in 0.246s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a87db855-69aa-44a9-bb5f-66b3540d8bf4" released by "_delete_snapshot" :: held 1.589s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" released by "delete_snapshot" :: held 1.610s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:37 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Created reservations ['7814c20f-72f4-4391-95d1-7b6366a58346', '7502a469-d2bc-43f7-9427-ab7c08b6c177', '53f1fb54-2d33-41e4-a74c-9941fa7ca57e', 'ac41d432-825b-475e-9425-d49cc83a5dd4'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:22:37 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Delete snapshot completed successfully. Aug 01 15:22:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53d032aa-f2d6-4413-bcf7-c9b9710cc542 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-a87db855-69aa-44a9-bb5f-66b3540d8bf4-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-b2e123fe-9b41-41fe-8a4b-edbd6731c00e-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-b2e123fe-9b41-41fe-8a4b-edbd6731c00e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-b2e123fe-9b41-41fe-8a4b-edbd6731c00e" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-b2e123fe-9b41-41fe-8a4b-edbd6731c00e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Deleting offline snapshot b2e123fe-9b41-41fe-8a4b-edbd6731c00e of volume a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] snapshot_file for this snap is: volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95c37b8-2ce2-44bc-ad89-17bc2bfbd8e1]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:38 devstack sudo[112258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e Aug 01 15:22:38 devstack sudo[112258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:38 devstack sudo[112258]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e" returned: 0 in 0.358s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a488f03e-d358-44f5-9b27-56c46c2a154b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:38 devstack sudo[112263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 Aug 01 15:22:38 devstack sudo[112263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:38 devstack sudo[112263]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:22:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:38 devstack sudo[112268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e Aug 01 15:22:38 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:39 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e" returned: 0 in 0.407s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:39 devstack sudo[112277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e Aug 01 15:22:39 devstack sudo[112277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:39 devstack sudo[112277]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.b2e123fe-9b41-41fe-8a4b-edbd6731c00e" returned: 0 in 0.236s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-b2e123fe-9b41-41fe-8a4b-edbd6731c00e" released by "_delete_snapshot" :: held 1.443s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" released by "delete_snapshot" :: held 1.465s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:39 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Created reservations ['173ee698-769c-4324-a2aa-eb2c697d132f', '866d4e05-6841-4fe9-aa0f-30274441fe14', 'e61d25da-83a7-496c-80a6-6318230611c1', 'eebdaa92-11af-4980-898d-6e2ed30a0617'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:22:39 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Delete snapshot completed successfully. Aug 01 15:22:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2273b8e4-c341-4ea3-823e-70197010a9e5 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-b2e123fe-9b41-41fe-8a4b-edbd6731c00e-delete_snapshot" released by "delete_snapshot" :: held 1.597s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-367d2e15-dd20-40ce-9256-2408e65b4be4-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-367d2e15-dd20-40ce-9256-2408e65b4be4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-367d2e15-dd20-40ce-9256-2408e65b4be4" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-367d2e15-dd20-40ce-9256-2408e65b4be4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Deleting offline snapshot 367d2e15-dd20-40ce-9256-2408e65b4be4 of volume a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] snapshot_file for this snap is: volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[104562cf-9ddf-423d-a323-e3d1c90b93ac]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:40 devstack sudo[112281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 Aug 01 15:22:40 devstack sudo[112281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:40 devstack sudo[112281]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4" returned: 0 in 0.343s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a95b90dd-8e75-4ad0-a245-6127fe609009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28855df-b560-4107-8fb4-ad7d9b8ad33b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:40 devstack sudo[112286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 Aug 01 15:22:40 devstack sudo[112286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:40 devstack sudo[112286]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009" returned: 0 in 0.345s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:40 devstack sudo[112291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 Aug 01 15:22:40 devstack sudo[112291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:41 devstack sudo[112291]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4" returned: 0 in 0.373s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:41 devstack sudo[112301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4 Aug 01 15:22:41 devstack sudo[112301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:41 devstack sudo[112301]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009.367d2e15-dd20-40ce-9256-2408e65b4be4" returned: 0 in 0.245s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:41 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=63,cinder:UPDATE=57,cinder:DELETE=3,cinder:INSERT=9 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:22:41 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=70,cinder:DELETE=4,cinder:UPDATE=42,cinder:INSERT=14 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:22:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-367d2e15-dd20-40ce-9256-2408e65b4be4" released by "_delete_snapshot" :: held 1.408s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" released by "delete_snapshot" :: held 1.433s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:41 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Created reservations ['514c8b55-aeb1-48f4-b31f-938307edb96e', 'df24eb04-2801-417f-a59b-684665fae4e7', '1b762d47-eab2-434a-b00f-9365c01eee40', 'eb54b018-8673-4f97-ad6d-a58b9fdf317b'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:22:41 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Delete snapshot completed successfully. Aug 01 15:22:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-53f99825-1946-480d-8258-637bc152c198 tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-367d2e15-dd20-40ce-9256-2408e65b4be4-delete_snapshot" released by "delete_snapshot" :: held 1.558s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-a95b90dd-8e75-4ad0-a245-6127fe609009-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-a95b90dd-8e75-4ad0-a245-6127fe609009-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:22:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" acquired by "delete_volume" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:22:42 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65df50b-63ee-4de2-807d-3fff715f0b00]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:22:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:42 devstack sudo[112304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 Aug 01 15:22:42 devstack sudo[112304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:42 devstack sudo[112304]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009" returned: 0 in 0.341s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:42 devstack sudo[112309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009 Aug 01 15:22:42 devstack sudo[112309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:43 devstack sudo[112309]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a95b90dd-8e75-4ad0-a245-6127fe609009" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-quobyte-a95b90dd-8e75-4ad0-a245-6127fe609009" released by "delete_volume" :: held 0.642s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Created reservations ['9faf9bb9-82a5-49f7-92a4-199c3fd10a59', 'b9d79a2b-2cf6-40e2-a3ce-b2fd0dd1600b', '9166036a-2a70-4962-8282-e7399d5e2742', '91c528a2-7056-4483-96fa-16d8a44cfa3a'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:22:43 devstack sudo[112312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:22:43 devstack sudo[112312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:22:43 devstack sudo[112312]: pam_unix(sudo:session): session closed for user root Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.240s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:22:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Deleted volume successfully. Aug 01 15:22:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-931610a7-bd63-4242-a7df-ee9463169f4a tempest-SnapshotDataIntegrityTests-1545401310 None] Lock "cinder-a95b90dd-8e75-4ad0-a245-6127fe609009-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:22:53 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=14 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:22:58 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (9432ad05-77f6-4ea8-a2fb-627e80bbba48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d5db09-38d9-4932-a3ec-7dd8ea9c856a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d5db09-38d9-4932-a3ec-7dd8ea9c856a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1411926752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8baaee3-db81-4206-93d8-7766e3bc8c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:06Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8d10ab-f71f-4b7a-96ca-2dbf811bc554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8d10ab-f71f-4b7a-96ca-2dbf811bc554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d483854f-cc90-44d6-8f8a-ee49d4aecd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d483854f-cc90-44d6-8f8a-ee49d4aecd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8baaee3-db81-4206-93d8-7766e3bc8c91', 'volume_name': 'volume-f8baaee3-db81-4206-93d8-7766e3bc8c91', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb5cc4a-5cb5-4412-946e-a1b0e8577cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb5cc4a-5cb5-4412-946e-a1b0e8577cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb98c0e-4d5b-4eca-9a23-013bb46bf15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:06 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Volume f8baaee3-db81-4206-93d8-7766e3bc8c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8baaee3-db81-4206-93d8-7766e3bc8c91', 'volume_size': 1} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1411926752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8baaee3-db81-4206-93d8-7766e3bc8c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:06Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Creating volume f8baaee3-db81-4206-93d8-7766e3bc8c91 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:06 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:06 devstack sudo[112390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 1073741824 Aug 01 15:23:06 devstack sudo[112390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (5fb8cf18-d177-4190-a29d-76bf044e524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8388ec8e-a183-41c7-8d99-c280a4a1e2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8388ec8e-a183-41c7-8d99-c280a4a1e2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2104011547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94ce170-f41a-48f1-bb64-b7a059e9f811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:07Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8be06b9-c942-42f0-a088-f2f5f5abf3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8be06b9-c942-42f0-a088-f2f5f5abf3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bb77b9-62c0-4e86-aad1-08c638426713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bb77b9-62c0-4e86-aad1-08c638426713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94ce170-f41a-48f1-bb64-b7a059e9f811', 'volume_name': 'volume-c94ce170-f41a-48f1-bb64-b7a059e9f811', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa4617b-98bc-48a4-8c72-f01ca0646660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa4617b-98bc-48a4-8c72-f01ca0646660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfa065b-5f31-46cc-9bca-58ea088647da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:07 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume c94ce170-f41a-48f1-bb64-b7a059e9f811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94ce170-f41a-48f1-bb64-b7a059e9f811', 'volume_size': 1} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:07 devstack sudo[112390]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 1073741824" returned: 0 in 0.546s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:07 devstack sudo[112396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 Aug 01 15:23:07 devstack sudo[112396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:07 devstack sudo[112396]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91" returned: 0 in 0.320s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2104011547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94ce170-f41a-48f1-bb64-b7a059e9f811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:07Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Creating volume c94ce170-f41a-48f1-bb64-b7a059e9f811 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:07 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:07 devstack sudo[112399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 1073741824 Aug 01 15:23:07 devstack sudo[112399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb98c0e-4d5b-4eca-9a23-013bb46bf15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8baaee3-db81-4206-93d8-7766e3bc8c91', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1ac9d7-4021-47e8-85f5-7e4709ee4f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:07 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Volume volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 (f8baaee3-db81-4206-93d8-7766e3bc8c91): created successfully Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1ac9d7-4021-47e8-85f5-7e4709ee4f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (9432ad05-77f6-4ea8-a2fb-627e80bbba48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0c32f111-365f-4285-b494-17610e9b77ae tempest-VolumeDependencyTests-841441038 None] Created volume successfully. Aug 01 15:23:08 devstack sudo[112399]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 1073741824" returned: 0 in 0.494s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:08 devstack sudo[112405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 Aug 01 15:23:08 devstack sudo[112405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:08 devstack sudo[112405]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811" returned: 0 in 0.276s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfa065b-5f31-46cc-9bca-58ea088647da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94ce170-f41a-48f1-bb64-b7a059e9f811', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2791179-547d-4a6e-a05c-8948efb3fd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:08 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 (c94ce170-f41a-48f1-bb64-b7a059e9f811): created successfully Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2791179-547d-4a6e-a05c-8948efb3fd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (5fb8cf18-d177-4190-a29d-76bf044e524d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f28030c7-13e7-4b83-b467-b7d794eee0be tempest-CreateVolumesFromSnapshotTest-974106271 None] Created volume successfully. Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] Creating offline snapshot 96a6309f-4ed1-4087-aa4d-349c0227e8ec of volume f8baaee3-db81-4206-93d8-7766e3bc8c91 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a253a271-bfbb-4e54-954d-22aa9fda439f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:08 devstack sudo[112408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 Aug 01 15:23:08 devstack sudo[112408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:09 devstack sudo[112408]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91" returned: 0 in 0.488s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:09 devstack sudo[112413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec 1G Aug 01 15:23:09 devstack sudo[112413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:09 devstack sudo[112413]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec 1G" returned: 0 in 0.522s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:09 devstack sudo[112419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec Aug 01 15:23:09 devstack sudo[112419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:10 devstack sudo[112419]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec" returned: 0 in 0.325s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:10 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec is being set with open permissions: ugo+rw Aug 01 15:23:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:10 devstack sudo[112425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec Aug 01 15:23:10 devstack sudo[112425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:10 devstack sudo[112425]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec" returned: 0 in 0.296s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:10 devstack sudo[112428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.info Aug 01 15:23:10 devstack sudo[112428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:10 devstack sudo[112428]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.info" returned: 0 in 0.277s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:10 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.info is being set with open permissions: ugo+rw Aug 01 15:23:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:10 devstack sudo[112431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.info Aug 01 15:23:10 devstack sudo[112431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:11 devstack sudo[112431]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.info" returned: 0 in 0.282s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.821s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Creating offline snapshot a0872952-d126-4c43-9b2b-e9b5913705e3 of volume c94ce170-f41a-48f1-bb64-b7a059e9f811 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:23:11 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a4df8c86-9f9f-481f-afeb-efdcfaa60119 tempest-VolumeDependencyTests-841441038 None] Create snapshot completed successfully Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3743ae78-b59a-4488-b2da-0647b2343f5a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:11 devstack sudo[112434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 Aug 01 15:23:11 devstack sudo[112434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:11 devstack sudo[112434]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811" returned: 0 in 0.432s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:11 devstack sudo[112439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 1G Aug 01 15:23:11 devstack sudo[112439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Flow 'volume_create_manager' (d5c42068-ddd4-4bff-86ef-c98143ecd8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76ab718-1712-4803-b8c0-690a01d6cb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76ab718-1712-4803-b8c0-690a01d6cb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51b18fd-08ce-4731-9e6f-71e72906f719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7bed003971438eb772a29f1176c459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:12Z,use_quota=True,user_id='3a9423902a6d4917a06e03f8f4e7d133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df368f21-2dec-49dd-91ef-758d80350e64),volume_type_id=df368f21-2dec-49dd-91ef-758d80350e64)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcbcabe-d9cb-4985-8cad-396222e4d0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcbcabe-d9cb-4985-8cad-396222e4d0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f112714-bb10-400b-b720-89e944386928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:11 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f112714-bb10-400b-b720-89e944386928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c51b18fd-08ce-4731-9e6f-71e72906f719', 'volume_name': 'volume-c51b18fd-08ce-4731-9e6f-71e72906f719', 'volume_size': 1, 'image_id': 'ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc32297a9d5cce464988705ffbbc1a66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9b7bed003971438eb772a29f1176c459', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02022a0af61d310aef5b674234aefa5bc7f878f91e9896462d2281610ebb3c066046318a2938b74e358de624455a41d4fcc4fa7c4c9acc29c476b44ce26ed27a', 'id': 'ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'created_at': datetime.datetime(2026, 8, 1, 13, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec2aef9f-f40e-4732-b945-3b5b4c4192a0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:12 devstack sudo[112439]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f71121-166b-4241-a2a7-bd5c84e275f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f71121-166b-4241-a2a7-bd5c84e275f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc523dd-646a-4610-8db6-67c0c0da77be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:12 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Volume c51b18fd-08ce-4731-9e6f-71e72906f719: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c51b18fd-08ce-4731-9e6f-71e72906f719', 'volume_size': 1, 'image_id': 'ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc32297a9d5cce464988705ffbbc1a66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9b7bed003971438eb772a29f1176c459', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02022a0af61d310aef5b674234aefa5bc7f878f91e9896462d2281610ebb3c066046318a2938b74e358de624455a41d4fcc4fa7c4c9acc29c476b44ce26ed27a', 'id': 'ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'created_at': datetime.datetime(2026, 8, 1, 13, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec2aef9f-f40e-4732-b945-3b5b4c4192a0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Trying to clone c51b18fd-08ce-4731-9e6f-71e72906f719 from image ec2aef9f-f40e-4732-b945-3b5b4c4192a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 1G" returned: 0 in 0.541s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:12 devstack sudo[112445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 Aug 01 15:23:12 devstack sudo[112445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:23:12 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Image download 0.00 MB at 0.00 MB/s Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0cbf2d-3c23-492b-a6f2-d76922e0249e]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:12 devstack sudo[112447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD Aug 01 15:23:12 devstack sudo[112447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:12 devstack sudo[112445]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3" returned: 0 in 0.519s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:12 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 is being set with open permissions: ugo+rw Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:12 devstack sudo[112453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 Aug 01 15:23:12 devstack sudo[112453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:12 devstack sudo[112447]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (ef815f2f-eb4b-4055-9ebb-3fc2dc0a04c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76065a0c-eec7-4691-a400-c3ea9814f576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76065a0c-eec7-4691-a400-c3ea9814f576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1882232749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6690bfa7-ec7b-47b7-970d-5c83310c06ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=96a6309f-4ed1-4087-aa4d-349c0227e8ec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:13Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ed2209-576b-4ada-ac70-728123080e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ed2209-576b-4ada-ac70-728123080e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc16302f-4984-4bb2-a3b0-b03d76ce427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc16302f-4984-4bb2-a3b0-b03d76ce427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6690bfa7-ec7b-47b7-970d-5c83310c06ab', 'volume_name': 'volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab', 'volume_size': 1, 'snapshot_id': '96a6309f-4ed1-4087-aa4d-349c0227e8ec'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5562478-9202-414d-8c04-74bbeb1e5998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5562478-9202-414d-8c04-74bbeb1e5998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f52a629-6ebc-467b-a021-98137860edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:12 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Volume 6690bfa7-ec7b-47b7-970d-5c83310c06ab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab', 'volume_size': 1, 'snapshot_id': '96a6309f-4ed1-4087-aa4d-349c0227e8ec'} Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:12 devstack sudo[112457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD Aug 01 15:23:12 devstack sudo[112457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:12 devstack sudo[112453]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3" returned: 0 in 0.326s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:13 devstack sudo[112460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.info Aug 01 15:23:13 devstack sudo[112460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:13 devstack sudo[112457]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD" returned: 1 in 0.393s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Temporary image ec2aef9f-f40e-4732-b945-3b5b4c4192a0 is fetched for user 3a9423902a6d4917a06e03f8f4e7d133. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cf0c00-65a5-4a5d-81e2-58dae617bb76]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:13 devstack sudo[112460]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.info" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:13 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.info is being set with open permissions: ugo+rw Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:13 devstack sudo[112465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD Aug 01 15:23:13 devstack sudo[112465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:13 devstack sudo[112467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.info Aug 01 15:23:13 devstack sudo[112467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:13 devstack sudo[112465]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:13 devstack sudo[112467]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.info" returned: 0 in 0.309s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.833s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-96a6309f-4ed1-4087-aa4d-349c0227e8ec-6690bfa7-ec7b-47b7-970d-5c83310c06ab" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:13 devstack sudo[112473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD Aug 01 15:23:13 devstack sudo[112473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-96a6309f-4ed1-4087-aa4d-349c0227e8ec-6690bfa7-ec7b-47b7-970d-5c83310c06ab" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Creating volume 6690bfa7-ec7b-47b7-970d-5c83310c06ab from snapshot 96a6309f-4ed1-4087-aa4d-349c0227e8ec {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-6690bfa7-ec7b-47b7-970d-5c83310c06ab" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:13 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d2c8875a-c667-4574-86d5-dfd4b63c8bf0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Create snapshot completed successfully Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-6690bfa7-ec7b-47b7-970d-5c83310c06ab" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] snapshot: 96a6309f-4ed1-4087-aa4d-349c0227e8ec, volume: 6690bfa7-ec7b-47b7-970d-5c83310c06ab, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2618d50-8e0e-4775-8486-0d23f8eba9df]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:13 devstack sudo[112475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec Aug 01 15:23:13 devstack sudo[112475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:13 devstack sudo[112473]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:23:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:14 devstack sudo[112475]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec" returned: 0 in 0.375s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8baaee3-db81-4206-93d8-7766e3bc8c91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:23:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6c1265-2c87-4715-81ee-4aa634e7d5b2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:14 devstack sudo[112483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 Aug 01 15:23:14 devstack sudo[112483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:14 devstack sudo[112483]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91" returned: 0 in 0.392s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:23:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:23:14 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:23:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:14 devstack sudo[112488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab Aug 01 15:23:14 devstack sudo[112488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (ccc55e00-4950-43df-bfcf-ce905e26e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5493eeb-c922-49da-a4d8-6c1cfadef896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5493eeb-c922-49da-a4d8-6c1cfadef896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080378618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77476085-19b2-48e2-b1e0-46b5d975c794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:15Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b312793-3388-4b55-b325-aac7acccea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b312793-3388-4b55-b325-aac7acccea41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b91740-7661-4e02-afee-e57c130e9e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b91740-7661-4e02-afee-e57c130e9e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77476085-19b2-48e2-b1e0-46b5d975c794', 'volume_name': 'volume-77476085-19b2-48e2-b1e0-46b5d975c794', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4340261d-6376-487c-af81-5b4e745008d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4340261d-6376-487c-af81-5b4e745008d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae96b87b-1aa6-4950-9643-8ac214972b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:15 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume 77476085-19b2-48e2-b1e0-46b5d975c794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77476085-19b2-48e2-b1e0-46b5d975c794', 'volume_size': 1} Aug 01 15:23:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (d5006567-9a62-4c99-a2d7-b6aaa90365d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0093f63-9596-46d7-b381-678fcb959df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0093f63-9596-46d7-b381-678fcb959df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1755590139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77b098c-41a6-4581-a512-8c3a4f71ef8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:16Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b0086d-7d6b-4ae6-bbea-54c011060cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b0086d-7d6b-4ae6-bbea-54c011060cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d98b4d0-4093-44fe-82d6-b3250852d6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d98b4d0-4093-44fe-82d6-b3250852d6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c77b098c-41a6-4581-a512-8c3a4f71ef8a', 'volume_name': 'volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895a5320-ded8-41b1-b4ad-7220771e21d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895a5320-ded8-41b1-b4ad-7220771e21d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3789179-7f38-40f2-8d0a-be8c79a371d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:16 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume c77b098c-41a6-4581-a512-8c3a4f71ef8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a', 'volume_size': 1} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (10d537c6-52b7-4a01-851b-28e7819b6189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d2c3fb-4af5-48bb-820f-8c085287b946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d2c3fb-4af5-48bb-820f-8c085287b946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1866247824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4062686-b83c-4fa6-bc7c-357e9c02e2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:17Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00c723e-7a7e-4832-8974-a73cb9bb57f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00c723e-7a7e-4832-8974-a73cb9bb57f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110e03b4-2fd8-470f-bb6b-6a3a6bb44529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110e03b4-2fd8-470f-bb6b-6a3a6bb44529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4062686-b83c-4fa6-bc7c-357e9c02e2b1', 'volume_name': 'volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c41a61-56e6-4490-9ac4-9926c9685aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c41a61-56e6-4490-9ac4-9926c9685aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f959bdfd-ad76-433f-8b3c-e8d5e7a52729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:17 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume e4062686-b83c-4fa6-bc7c-357e9c02e2b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1', 'volume_size': 1} Aug 01 15:23:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (5dd43d38-cc41-4313-8813-98b26453a451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8241bcf7-7088-4a00-8a07-1a4ca8366acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8241bcf7-7088-4a00-8a07-1a4ca8366acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-54832030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:18Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c8d467-e2a0-44ca-9e9a-09f665282667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c8d467-e2a0-44ca-9e9a-09f665282667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0deca96b-5a5e-4d70-b152-ecd972bd4a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0deca96b-5a5e-4d70-b152-ecd972bd4a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb', 'volume_name': 'volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952df1c7-59cf-41c6-b54a-7b5940cc1496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952df1c7-59cf-41c6-b54a-7b5940cc1496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613cae86-bd76-48e3-bd24-fd4e586bd4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:18 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume 6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb', 'volume_size': 1} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:18 devstack sudo[112501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:18 devstack sudo[112501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:18 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (67a695ac-3783-4755-af23-0fecfc543769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7924a3c1-3f36-4c24-8132-dd81e3bb86ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7924a3c1-3f36-4c24-8132-dd81e3bb86ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-391328051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b865d5aa-b8a8-4415-905b-96087fe87e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:19Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fa2c7f-cef7-4dfa-b4d9-446adea26ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fa2c7f-cef7-4dfa-b4d9-446adea26ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcc9ea6-59bb-43e4-b55b-4e6422091ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:19 devstack sudo[112501]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcc9ea6-59bb-43e4-b55b-4e6422091ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b865d5aa-b8a8-4415-905b-96087fe87e99', 'volume_name': 'volume-b865d5aa-b8a8-4415-905b-96087fe87e99', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a2a4fc-cded-42d4-95f5-96b6d3450131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a2a4fc-cded-42d4-95f5-96b6d3450131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af097d3-2b64-4692-aa31-aa76807cd240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:19 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume b865d5aa-b8a8-4415-905b-96087fe87e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b865d5aa-b8a8-4415-905b-96087fe87e99', 'volume_size': 1} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.719s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:23:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:23:20 devstack sudo[112488]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab" returned: 0 in 5.906s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:23:20 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Converted 1024.00 MB image at 173.37 MB/s Aug 01 15:23:20 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab is being set with open permissions: ugo+rw Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:20 devstack sudo[112539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab Aug 01 15:23:20 devstack sudo[112539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:20 devstack sudo[112539]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab" returned: 0 in 0.295s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-6690bfa7-ec7b-47b7-970d-5c83310c06ab" released by "_copy_volume_from_snapshot" :: held 7.062s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-96a6309f-4ed1-4087-aa4d-349c0227e8ec-6690bfa7-ec7b-47b7-970d-5c83310c06ab" released by "_create_volume_from_snapshot" :: held 7.136s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.176s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.901s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51b18fd-08ce-4731-9e6f-71e72906f719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b7bed003971438eb772a29f1176c459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:12Z,use_quota=True,user_id='3a9423902a6d4917a06e03f8f4e7d133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df368f21-2dec-49dd-91ef-758d80350e64),volume_type_id=df368f21-2dec-49dd-91ef-758d80350e64)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Creating volume c51b18fd-08ce-4731-9e6f-71e72906f719 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:20 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:20 devstack sudo[112544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 1073741824 Aug 01 15:23:20 devstack sudo[112544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f52a629-6ebc-467b-a021-98137860edbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab', 'volume_size': 1, 'snapshot_id': '96a6309f-4ed1-4087-aa4d-349c0227e8ec'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b55e599-8c6c-4c4a-b0a3-ea085f27edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:20 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Volume volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab (6690bfa7-ec7b-47b7-970d-5c83310c06ab): created successfully Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b55e599-8c6c-4c4a-b0a3-ea085f27edd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (ef815f2f-eb4b-4055-9ebb-3fc2dc0a04c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:20 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-952e5145-a880-457b-baf7-5ade81e1ccc1 tempest-VolumeDependencyTests-841441038 None] Created volume successfully. Aug 01 15:23:21 devstack sudo[112544]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 1073741824" returned: 0 in 0.487s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:21 devstack sudo[112550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 Aug 01 15:23:21 devstack sudo[112550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:21 devstack sudo[112550]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719" returned: 0 in 0.356s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.537s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080378618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77476085-19b2-48e2-b1e0-46b5d975c794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:15Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Creating volume 77476085-19b2-48e2-b1e0-46b5d975c794 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:21 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:21 devstack sudo[112553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794 1073741824 Aug 01 15:23:21 devstack sudo[112553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Attempting download of ec2aef9f-f40e-4732-b945-3b5b4c4192a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'metadata': {}}])) to volume c51b18fd-08ce-4731-9e6f-71e72906f719. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdacef3-3561-4149-a904-a0261607b915]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_1yzvt1nx {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:22 devstack sudo[112555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_1yzvt1nx Aug 01 15:23:22 devstack sudo[112555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:22 devstack sudo[112555]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_1yzvt1nx" returned: 0 in 0.431s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_1yzvt1nx {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:22 devstack sudo[112553]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794 1073741824" returned: 0 in 0.658s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:22 devstack sudo[112563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_1yzvt1nx Aug 01 15:23:22 devstack sudo[112563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:22 devstack sudo[112564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794 Aug 01 15:23:22 devstack sudo[112564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:22 devstack sudo[112563]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_1yzvt1nx" returned: 1 in 0.380s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_1yzvt1nx' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc3b0ff-e8a7-4904-9bbf-7ddde5b9c89e]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:22 devstack sudo[112564]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794" returned: 0 in 0.297s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.423s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1755590139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77b098c-41a6-4581-a512-8c3a4f71ef8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:16Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Creating volume c77b098c-41a6-4581-a512-8c3a4f71ef8a {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:22 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae96b87b-1aa6-4950-9643-8ac214972b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77476085-19b2-48e2-b1e0-46b5d975c794', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:22 devstack sudo[112574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a 1073741824 Aug 01 15:23:22 devstack sudo[112574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72a11a8-fc25-4aca-b719-cc8c689b3122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:22 devstack sudo[112570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD Aug 01 15:23:22 devstack sudo[112570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:22 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume volume-77476085-19b2-48e2-b1e0-46b5d975c794 (77476085-19b2-48e2-b1e0-46b5d975c794): created successfully Aug 01 15:23:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72a11a8-fc25-4aca-b719-cc8c689b3122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (ccc55e00-4950-43df-bfcf-ce905e26e676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7517fd12-58e1-4906-981a-eb6d24abdf42 tempest-CreateVolumesFromSnapshotTest-974106271 None] Created volume successfully. Aug 01 15:23:23 devstack sudo[112570]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:23 devstack sudo[112582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD Aug 01 15:23:23 devstack sudo[112582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:23 devstack sudo[112574]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a 1073741824" returned: 0 in 0.731s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:23 devstack sudo[112582]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] ec2aef9f-f40e-4732-b945-3b5b4c4192a0 was raw, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:23:23 devstack sudo[112590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a Aug 01 15:23:23 devstack sudo[112590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:23 devstack sudo[112592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 Aug 01 15:23:23 devstack sudo[112592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:23 devstack sudo[112590]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a" returned: 0 in 0.302s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.795s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1866247824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4062686-b83c-4fa6-bc7c-357e9c02e2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:17Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Creating volume e4062686-b83c-4fa6-bc7c-357e9c02e2b1 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:23 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3789179-7f38-40f2-8d0a-be8c79a371d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f63f65-f332-4c12-ae86-ec55bc211d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:23 devstack sudo[112598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1 1073741824 Aug 01 15:23:23 devstack sudo[112598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:23 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a (c77b098c-41a6-4581-a512-8c3a4f71ef8a): created successfully Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f63f65-f332-4c12-ae86-ec55bc211d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (d5006567-9a62-4c99-a2d7-b6aaa90365d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:24 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fe8f7124-9f41-4201-b299-a8fe5e3539ca tempest-CreateVolumesFromSnapshotTest-974106271 None] Created volume successfully. Aug 01 15:23:24 devstack sudo[112592]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719" returned: 0 in 0.576s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ec2aef9f-f40e-4732-b945-3b5b4c4192a0_95drm5srdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:23:24 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Converted 0.00 MB image at 0.00 MB/s Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:24 devstack sudo[112602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 1G Aug 01 15:23:24 devstack sudo[112602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:24 devstack sudo[112598]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1 1073741824" returned: 0 in 0.618s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:24 devstack sudo[112602]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 1G" returned: 0 in 0.380s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Downloaded image ec2aef9f-f40e-4732-b945-3b5b4c4192a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'metadata': {}}])) to volume c51b18fd-08ce-4731-9e6f-71e72906f719 successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Temporary image ec2aef9f-f40e-4732-b945-3b5b4c4192a0 for user 3a9423902a6d4917a06e03f8f4e7d133 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Marking volume c51b18fd-08ce-4731-9e6f-71e72906f719 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:23:24 devstack sudo[112611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1 Aug 01 15:23:24 devstack sudo[112611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Copying metadata from image ec2aef9f-f40e-4732-b945-3b5b4c4192a0 to c51b18fd-08ce-4731-9e6f-71e72906f719. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Creating volume glance metadata for volume c51b18fd-08ce-4731-9e6f-71e72906f719 backed by image ec2aef9f-f40e-4732-b945-3b5b4c4192a0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cc32297a9d5cce464988705ffbbc1a66', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc523dd-646a-4610-8db6-67c0c0da77be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51b18fd-08ce-4731-9e6f-71e72906f719', 'volume_size': 1, 'image_id': 'ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cc32297a9d5cce464988705ffbbc1a66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9b7bed003971438eb772a29f1176c459', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02022a0af61d310aef5b674234aefa5bc7f878f91e9896462d2281610ebb3c066046318a2938b74e358de624455a41d4fcc4fa7c4c9acc29c476b44ce26ed27a', 'id': 'ec2aef9f-f40e-4732-b945-3b5b4c4192a0', 'created_at': datetime.datetime(2026, 8, 1, 13, 23, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 23, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec2aef9f-f40e-4732-b945-3b5b4c4192a0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1520210-2536-423d-91dd-0b4c7f4eb11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:24 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Volume volume-c51b18fd-08ce-4731-9e6f-71e72906f719 (c51b18fd-08ce-4731-9e6f-71e72906f719): created successfully Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1520210-2536-423d-91dd-0b4c7f4eb11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Flow 'volume_create_manager' (d5c42068-ddd4-4bff-86ef-c98143ecd8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:24 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-9f306f0e-07f8-4b8b-afc7-41e7a35a16da tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Created volume successfully. Aug 01 15:23:24 devstack sudo[112611]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1" returned: 0 in 0.282s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.390s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-54832030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:18Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Creating volume 6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:24 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f959bdfd-ad76-433f-8b3c-e8d5e7a52729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:24 devstack sudo[112614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb 1073741824 Aug 01 15:23:24 devstack sudo[112614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdd2d96-3192-4a30-9e52-45e905c6fe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:24 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1 (e4062686-b83c-4fa6-bc7c-357e9c02e2b1): created successfully Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdd2d96-3192-4a30-9e52-45e905c6fe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (10d537c6-52b7-4a01-851b-28e7819b6189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:24 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-55586ee4-8868-46a3-af23-3d63e217868a tempest-CreateVolumesFromSnapshotTest-974106271 None] Created volume successfully. Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Acquiring lock "cinder-c51b18fd-08ce-4731-9e6f-71e72906f719-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Lock "cinder-c51b18fd-08ce-4731-9e6f-71e72906f719-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Acquiring lock "cinder-quobyte-c51b18fd-08ce-4731-9e6f-71e72906f719" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Lock "cinder-quobyte-c51b18fd-08ce-4731-9e6f-71e72906f719" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:25 devstack sudo[112614]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb 1073741824" returned: 0 in 0.663s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de4bead-4112-42cd-8f4e-06a9db892362]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:25 devstack sudo[112621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb Aug 01 15:23:25 devstack sudo[112621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:25 devstack sudo[112620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 Aug 01 15:23:25 devstack sudo[112620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:25 devstack sudo[112621]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.614s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-391328051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b865d5aa-b8a8-4415-905b-96087fe87e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2341fab074652a8dbc20a1a8eb634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:19Z,use_quota=True,user_id='248ebdd92b3346cb9c2d9ed42140530f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Creating volume b865d5aa-b8a8-4415-905b-96087fe87e99 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:25 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613cae86-bd76-48e3-bd24-fd4e586bd4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:25 devstack sudo[112627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99 1073741824 Aug 01 15:23:25 devstack sudo[112627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25e690e-b4d6-44b7-831e-06f393391066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:25 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb (6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb): created successfully Aug 01 15:23:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25e690e-b4d6-44b7-831e-06f393391066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (5dd43d38-cc41-4313-8813-98b26453a451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:26 devstack sudo[112620]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719" returned: 0 in 0.446s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-9f5a6c29-165b-4de4-b545-357401b105d7 tempest-CreateVolumesFromSnapshotTest-974106271 None] Created volume successfully. Aug 01 15:23:26 devstack sudo[112630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719 Aug 01 15:23:26 devstack sudo[112630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:26 devstack sudo[112630]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c51b18fd-08ce-4731-9e6f-71e72906f719" returned: 0 in 0.283s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Lock "cinder-quobyte-c51b18fd-08ce-4731-9e6f-71e72906f719" released by "delete_volume" :: held 0.773s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Created reservations ['ffbd74f6-9165-4dfa-9237-0ae3aca9125f', '80194d26-491d-40d4-b824-6375f540d6bc', '1a202c49-c637-4395-a907-5dde8c5769c5', '386d6dc8-2343-480f-b694-e9fb2631d96a'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:26 devstack sudo[112627]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99 1073741824" returned: 0 in 0.499s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:26 devstack sudo[112638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:26 devstack sudo[112638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:26 devstack sudo[112639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99 Aug 01 15:23:26 devstack sudo[112639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:26 devstack sudo[112638]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.403s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:26 devstack sudo[112639]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99" returned: 0 in 0.395s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Deleted volume successfully. Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.743s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] Creating offline snapshot 1a9893a8-2626-48cc-a5dc-25cae6fcad36 of volume 6690bfa7-ec7b-47b7-970d-5c83310c06ab {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af097d3-2b64-4692-aa31-aa76807cd240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b865d5aa-b8a8-4415-905b-96087fe87e99', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30ec6b1-7350-4234-842a-cc1fdfa975d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-57ec197d-2121-4679-84ef-7a52efb3d5b4 tempest-VolumeAndVolumeTypeFromImageTest-457782941 None] Lock "cinder-c51b18fd-08ce-4731-9e6f-71e72906f719-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eedb994-4692-4072-8ff0-55e8c1077cca]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:26 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Volume volume-b865d5aa-b8a8-4415-905b-96087fe87e99 (b865d5aa-b8a8-4415-905b-96087fe87e99): created successfully Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30ec6b1-7350-4234-842a-cc1fdfa975d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Flow 'volume_create_manager' (67a695ac-3783-4755-af23-0fecfc543769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:27 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cd9aface-25ec-4fa6-8ce5-f2da05e07a0a tempest-CreateVolumesFromSnapshotTest-974106271 None] Created volume successfully. Aug 01 15:23:27 devstack sudo[112644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab Aug 01 15:23:27 devstack sudo[112644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:27 devstack sudo[112644]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab" returned: 0 in 0.468s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:27 devstack sudo[112649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 1G Aug 01 15:23:27 devstack sudo[112649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-b865d5aa-b8a8-4415-905b-96087fe87e99-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-b865d5aa-b8a8-4415-905b-96087fe87e99-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-quobyte-b865d5aa-b8a8-4415-905b-96087fe87e99" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-b865d5aa-b8a8-4415-905b-96087fe87e99" acquired by "delete_volume" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:28 devstack sudo[112649]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 1G" returned: 0 in 0.639s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cc5ac4-9f30-4e0f-8850-46a71667af3d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:28 devstack sudo[112655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 Aug 01 15:23:28 devstack sudo[112655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:28 devstack sudo[112656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99 Aug 01 15:23:28 devstack sudo[112656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:28 devstack sudo[112655]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36" returned: 0 in 0.380s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:28 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 is being set with open permissions: ugo+rw Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:28 devstack sudo[112662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 Aug 01 15:23:28 devstack sudo[112662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:28 devstack sudo[112656]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99" returned: 0 in 0.559s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:28 devstack sudo[112667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99 Aug 01 15:23:28 devstack sudo[112667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:28 devstack sudo[112662]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36" returned: 0 in 0.356s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:28 devstack sudo[112670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.info Aug 01 15:23:28 devstack sudo[112670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:28 devstack sudo[112667]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b865d5aa-b8a8-4415-905b-96087fe87e99" returned: 0 in 0.286s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-b865d5aa-b8a8-4415-905b-96087fe87e99" released by "delete_volume" :: held 0.913s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Created reservations ['fcef15a8-707d-4eb3-af7e-0f6547f3c4d2', '6f337258-6ac1-44e0-9863-0ec5e661c196', '352059f3-5424-418a-9d39-41e01193952a', 'ca3bc91a-e3f9-4daa-b5b2-695ba73f2068'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:29 devstack sudo[112675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:29 devstack sudo[112675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:29 devstack sudo[112670]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.info" returned: 0 in 0.449s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:29 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.info is being set with open permissions: ugo+rw Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:29 devstack sudo[112678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.info Aug 01 15:23:29 devstack sudo[112678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:29 devstack sudo[112675]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.344s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:29 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Deleted volume successfully. Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-af10fe45-770c-43d6-a629-bf33c8a53946 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-b865d5aa-b8a8-4415-905b-96087fe87e99-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:29 devstack sudo[112678]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.info" returned: 0 in 0.387s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.808s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:29 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-60cc6604-7cdb-432d-9316-e9b32ae03e2b tempest-VolumeDependencyTests-841441038 None] Create snapshot completed successfully Aug 01 15:23:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-quobyte-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:30 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[660fec9a-ce3a-40d8-949c-4eec697b322f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:30 devstack sudo[112683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb Aug 01 15:23:30 devstack sudo[112683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:30 devstack sudo[112683]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb" returned: 0 in 0.588s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:30 devstack sudo[112688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb Aug 01 15:23:30 devstack sudo[112688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:31 devstack sudo[112688]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb" returned: 0 in 0.362s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb" released by "delete_volume" :: held 1.022s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (c406e42c-bf9f-4831-a1aa-4fdc306a8063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a2160b-784b-4743-b234-7f8953e531dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a2160b-784b-4743-b234-7f8953e531dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-489601504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ab782f-c9d8-47cb-a27e-6a0be61f9b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a9893a8-2626-48cc-a5dc-25cae6fcad36,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:31Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29374122-4b83-441b-baa3-6723dc813411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29374122-4b83-441b-baa3-6723dc813411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06040f3f-485d-4c1e-85be-d6b7f774dde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06040f3f-485d-4c1e-85be-d6b7f774dde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15ab782f-c9d8-47cb-a27e-6a0be61f9b58', 'volume_name': 'volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58', 'volume_size': 1, 'snapshot_id': '1a9893a8-2626-48cc-a5dc-25cae6fcad36'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a88ee81-81d7-44af-97c6-785d4d80aa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a88ee81-81d7-44af-97c6-785d4d80aa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fd4b2c-42e3-4a07-9a2f-a9797d058a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:31 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Volume 15ab782f-c9d8-47cb-a27e-6a0be61f9b58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58', 'volume_size': 1, 'snapshot_id': '1a9893a8-2626-48cc-a5dc-25cae6fcad36'} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-1a9893a8-2626-48cc-a5dc-25cae6fcad36-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-1a9893a8-2626-48cc-a5dc-25cae6fcad36-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Creating volume 15ab782f-c9d8-47cb-a27e-6a0be61f9b58 from snapshot 1a9893a8-2626-48cc-a5dc-25cae6fcad36 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] snapshot: 1a9893a8-2626-48cc-a5dc-25cae6fcad36, volume: 15ab782f-c9d8-47cb-a27e-6a0be61f9b58, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Created reservations ['1926267d-0139-4e73-b830-40f16c28bc47', '5e00de26-d386-4893-a5eb-fb87227e146c', 'af649919-3278-4349-91fc-12f723e3fdeb', 'acd04340-8fed-4749-9c69-fa2e93c988da'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[469f5bdd-4f46-48b1-b193-8f381c39dd82]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:31 devstack sudo[112691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 Aug 01 15:23:31 devstack sudo[112691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:31 devstack sudo[112692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:31 devstack sudo[112692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:32 devstack sudo[112692]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.323s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:32 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Deleted volume successfully. Aug 01 15:23:32 devstack sudo[112691]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36" returned: 0 in 0.480s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-88ba6fe7-9232-4e9c-ba29-26e97b8f286d tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-6b8b5995-a26f-4b3c-9148-fcfb7f5cdffb-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0beaf4-fcff-417e-a70d-58893b295a32]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:32 devstack sudo[112700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab Aug 01 15:23:32 devstack sudo[112700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-e4062686-b83c-4fa6-bc7c-357e9c02e2b1-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:32 devstack sudo[112700]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab" returned: 0 in 0.597s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-e4062686-b83c-4fa6-bc7c-357e9c02e2b1-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:32 devstack sudo[112705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 Aug 01 15:23:32 devstack sudo[112705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Flow 'volume_create_manager' (a9cf9505-f7c0-4901-b609-0e7b47c65cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3621589-d8fa-492a-84f0-c639bcaf6fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3621589-d8fa-492a-84f0-c639bcaf6fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-443761441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c03c129-28aa-4022-b8be-45fa7ba13977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846450399cf4e448d7f9c6b0edf0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:33Z,use_quota=True,user_id='f209c8aa8ee8419f8314a053f22eb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09747c96-333b-44f4-a26d-44462be8c6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09747c96-333b-44f4-a26d-44462be8c6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35fb2738-dd60-428d-a3cc-a3c345e27615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35fb2738-dd60-428d-a3cc-a3c345e27615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c03c129-28aa-4022-b8be-45fa7ba13977', 'volume_name': 'volume-0c03c129-28aa-4022-b8be-45fa7ba13977', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45476bf8-4756-490e-ae32-b6808ec60483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45476bf8-4756-490e-ae32-b6808ec60483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba614e9-4df3-4e94-bf65-fab5339f2799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:32 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Volume 0c03c129-28aa-4022-b8be-45fa7ba13977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c03c129-28aa-4022-b8be-45fa7ba13977', 'volume_size': 1} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-quobyte-e4062686-b83c-4fa6-bc7c-357e9c02e2b1" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-e4062686-b83c-4fa6-bc7c-357e9c02e2b1" acquired by "delete_volume" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[037c13f8-b304-4507-8402-8a601fd23550]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:33 devstack sudo[112707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1 Aug 01 15:23:33 devstack sudo[112707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Flow 'volume_create_manager' (4c82e335-3aa0-4854-ab0e-58b06d629a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ad4c87-8d48-4528-bfb1-f3769e141481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ad4c87-8d48-4528-bfb1-f3769e141481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1893382197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db71b01-f787-4616-bd63-f27cc7d60712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846450399cf4e448d7f9c6b0edf0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:33Z,use_quota=True,user_id='f209c8aa8ee8419f8314a053f22eb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbf84c5-6a90-4810-b91f-166427e5eda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbf84c5-6a90-4810-b91f-166427e5eda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fa1e96-f727-45a2-a43c-3cad245d314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8fa1e96-f727-45a2-a43c-3cad245d314a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db71b01-f787-4616-bd63-f27cc7d60712', 'volume_name': 'volume-0db71b01-f787-4616-bd63-f27cc7d60712', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9c5c6e-36b7-4edf-876d-00b0881c12ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9c5c6e-36b7-4edf-876d-00b0881c12ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc5a3a7-c9ca-468b-9a37-4a5cb3c0e30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:33 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Volume 0db71b01-f787-4616-bd63-f27cc7d60712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db71b01-f787-4616-bd63-f27cc7d60712', 'volume_size': 1} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:33 devstack sudo[112705]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" returned: 0 in 0.731s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:23:33 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 01 15:23:33 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 is being set with open permissions: ugo+rw Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:33 devstack sudo[112713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 Aug 01 15:23:33 devstack sudo[112713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:33 devstack sudo[112707]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1" returned: 0 in 0.638s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:33 devstack sudo[112718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1 Aug 01 15:23:33 devstack sudo[112718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Flow 'volume_create_manager' (0290f8cd-51aa-4105-a9ee-5f9abc3c60db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:33 devstack sudo[112713]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:33 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c081f6-74d7-4138-abd0-a944dac9cff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" returned: 0 in 0.512s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c081f6-74d7-4138-abd0-a944dac9cff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1488585874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb329b2-c60b-44d4-890b-03276773cc69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846450399cf4e448d7f9c6b0edf0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:34Z,use_quota=True,user_id='f209c8aa8ee8419f8314a053f22eb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e33e4ca-3ced-42e8-8939-cf378e99cb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e33e4ca-3ced-42e8-8939-cf378e99cb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e4f806-b805-491b-a032-60aa4d07af7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e4f806-b805-491b-a032-60aa4d07af7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb329b2-c60b-44d4-890b-03276773cc69', 'volume_name': 'volume-0cb329b2-c60b-44d4-890b-03276773cc69', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1912f961-d02b-42b2-af55-e5429948da15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1912f961-d02b-42b2-af55-e5429948da15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4cb1ee-467f-420d-bcf7-7e7b27886e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:34 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Volume 0cb329b2-c60b-44d4-890b-03276773cc69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb329b2-c60b-44d4-890b-03276773cc69', 'volume_size': 1} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" released by "_copy_volume_from_snapshot" :: held 2.575s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:34 devstack sudo[112718]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e4062686-b83c-4fa6-bc7c-357e9c02e2b1" returned: 0 in 0.429s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-e4062686-b83c-4fa6-bc7c-357e9c02e2b1" released by "delete_volume" :: held 1.140s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-1a9893a8-2626-48cc-a5dc-25cae6fcad36-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" released by "_create_volume_from_snapshot" :: held 2.729s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.755s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.265s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-443761441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c03c129-28aa-4022-b8be-45fa7ba13977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846450399cf4e448d7f9c6b0edf0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:33Z,use_quota=True,user_id='f209c8aa8ee8419f8314a053f22eb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Creating volume 0c03c129-28aa-4022-b8be-45fa7ba13977 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:34 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Created reservations ['8be0c71a-2aae-43ed-adb7-587f3ed1521c', 'f979794a-f6ef-44d6-a4d5-0884b9ca54e8', 'd45c0084-c09e-4a54-945a-19e1f1e50040', '983b5a65-6fa0-4cd9-acd4-64df30a69952'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:34 devstack sudo[112722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977 1073741824 Aug 01 15:23:34 devstack sudo[112722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fd4b2c-42e3-4a07-9a2f-a9797d058a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58', 'volume_size': 1, 'snapshot_id': '1a9893a8-2626-48cc-a5dc-25cae6fcad36'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fa094a-f7ee-4b5d-b658-83d0f572bfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:34 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Volume volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 (15ab782f-c9d8-47cb-a27e-6a0be61f9b58): created successfully Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fa094a-f7ee-4b5d-b658-83d0f572bfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (c406e42c-bf9f-4831-a1aa-4fdc306a8063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:34 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7a35c2b5-7faa-4538-b445-4b5df41dced0 tempest-VolumeDependencyTests-841441038 None] Created volume successfully. Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:34 devstack sudo[112724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:34 devstack sudo[112724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Flow 'volume_create_manager' (9a5596d0-4a4a-468d-a057-86563c3e7656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (316fa7aa-fe7c-4f9f-9c0d-cafd3cc423e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (316fa7aa-fe7c-4f9f-9c0d-cafd3cc423e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1800999343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d80f61-55a6-4051-84a1-42a166fe70d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846450399cf4e448d7f9c6b0edf0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:35Z,use_quota=True,user_id='f209c8aa8ee8419f8314a053f22eb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2b5a69-125a-4ce9-b8bc-5b1e45eeedbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f2b5a69-125a-4ce9-b8bc-5b1e45eeedbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12018aca-d685-4054-8d3c-f384b87cf181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12018aca-d685-4054-8d3c-f384b87cf181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d80f61-55a6-4051-84a1-42a166fe70d9', 'volume_name': 'volume-44d80f61-55a6-4051-84a1-42a166fe70d9', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a100eac-5985-4fa8-b443-e833fc9d32b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a100eac-5985-4fa8-b443-e833fc9d32b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af0c4b7-777c-44ad-b7c8-9f729c3658af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:34 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Volume 44d80f61-55a6-4051-84a1-42a166fe70d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d80f61-55a6-4051-84a1-42a166fe70d9', 'volume_size': 1} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:34 devstack sudo[112724]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.502s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:34 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:34 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Deleted volume successfully. Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-bd9907d3-2e66-4211-aaa5-98467ea3cdd0 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-e4062686-b83c-4fa6-bc7c-357e9c02e2b1-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-c77b098c-41a6-4581-a512-8c3a4f71ef8a-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-c77b098c-41a6-4581-a512-8c3a4f71ef8a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-quobyte-c77b098c-41a6-4581-a512-8c3a4f71ef8a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:35 devstack sudo[112722]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977 1073741824" returned: 0 in 1.120s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-c77b098c-41a6-4581-a512-8c3a4f71ef8a" acquired by "delete_volume" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Flow 'volume_create_manager' (07678c49-7e18-4bd0-bed8-fba2aa229c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd94361-9d21-4221-bdea-bd1584a39583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5013d845-b71c-4845-ac1c-fb235369269f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd94361-9d21-4221-bdea-bd1584a39583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1819315219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e783698-db3d-4d82-90aa-ac948f62d86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846450399cf4e448d7f9c6b0edf0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:35Z,use_quota=True,user_id='f209c8aa8ee8419f8314a053f22eb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7bd891-c548-4a03-9910-4d3dddb2e699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7bd891-c548-4a03-9910-4d3dddb2e699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d32d179-a5d6-444f-bd40-d4773cf11088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d32d179-a5d6-444f-bd40-d4773cf11088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e783698-db3d-4d82-90aa-ac948f62d86a', 'volume_name': 'volume-2e783698-db3d-4d82-90aa-ac948f62d86a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650e65f6-383c-46bb-a187-3b10ff144a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650e65f6-383c-46bb-a187-3b10ff144a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f08e92-b5ee-45a6-a9ca-6fbffbfac2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:35 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Volume 2e783698-db3d-4d82-90aa-ac948f62d86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e783698-db3d-4d82-90aa-ac948f62d86a', 'volume_size': 1} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:35 devstack sudo[112731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977 Aug 01 15:23:35 devstack sudo[112731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:35 devstack sudo[112730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a Aug 01 15:23:35 devstack sudo[112730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (8ff5c1c8-25c6-40ad-a834-c1fca4d48ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3ecb2a-e3d9-41a2-89c9-1822b7429dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3ecb2a-e3d9-41a2-89c9-1822b7429dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-39905861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3dbb29d-797a-4e72-8a94-e365c7d5c60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=15ab782f-c9d8-47cb-a27e-6a0be61f9b58,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:36Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4723cfcb-6803-4674-8d20-a15876709462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4723cfcb-6803-4674-8d20-a15876709462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928087b9-c9d3-4074-ad51-0f1c0d6bfc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928087b9-c9d3-4074-ad51-0f1c0d6bfc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e3dbb29d-797a-4e72-8a94-e365c7d5c60d', 'volume_name': 'volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d', 'volume_size': 1, 'source_volid': '15ab782f-c9d8-47cb-a27e-6a0be61f9b58', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db2e77a-5b25-4109-9cd0-ea335b36aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:35 devstack sudo[112731]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:35 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db2e77a-5b25-4109-9cd0-ea335b36aee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dc0522-46dc-44fd-a269-cd4f6c482c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:36 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Volume e3dbb29d-797a-4e72-8a94-e365c7d5c60d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d', 'volume_size': 1, 'source_volid': '15ab782f-c9d8-47cb-a27e-6a0be61f9b58', 'source_volstatus': 'available'} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977" returned: 0 in 0.392s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.662s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1893382197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db71b01-f787-4616-bd63-f27cc7d60712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846450399cf4e448d7f9c6b0edf0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:33Z,use_quota=True,user_id='f209c8aa8ee8419f8314a053f22eb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Creating volume 0db71b01-f787-4616-bd63-f27cc7d60712 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:36 devstack sudo[112730]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:36 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a" returned: 0 in 0.635s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:36 devstack sudo[112738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712 1073741824 Aug 01 15:23:36 devstack sudo[112738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba614e9-4df3-4e94-bf65-fab5339f2799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c03c129-28aa-4022-b8be-45fa7ba13977', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4b6c5b-92ab-4692-9091-5b8654bc6e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:36 devstack sudo[112740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a Aug 01 15:23:36 devstack sudo[112740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:36 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Volume volume-0c03c129-28aa-4022-b8be-45fa7ba13977 (0c03c129-28aa-4022-b8be-45fa7ba13977): created successfully Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4b6c5b-92ab-4692-9091-5b8654bc6e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Flow 'volume_create_manager' (a9cf9505-f7c0-4901-b609-0e7b47c65cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:36 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-553cc75b-0e38-4f89-a799-cfe24da8c9e1 tempest-CreateVolumesFromImageTest-1740936655 None] Created volume successfully. Aug 01 15:23:36 devstack sudo[112740]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c77b098c-41a6-4581-a512-8c3a4f71ef8a" returned: 0 in 0.395s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-c77b098c-41a6-4581-a512-8c3a4f71ef8a" released by "delete_volume" :: held 1.112s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Created reservations ['bbdb230d-3ea1-4ebc-aa3f-c031108e47fc', '57925b9a-b4be-4561-bc30-0a3980981c16', '4af336e6-e16b-4288-8a27-cd7d8d7254d7', '3cddc80e-03ca-4281-b89d-fa798af599de'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:36 devstack sudo[112738]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712 1073741824" returned: 0 in 0.610s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:36 devstack sudo[112747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:36 devstack sudo[112747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:36 devstack sudo[112749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712 Aug 01 15:23:36 devstack sudo[112749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:36 devstack sudo[112747]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.323s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:36 devstack sudo[112749]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:36 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Deleted volume successfully. Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712" returned: 0 in 0.287s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.895s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1488585874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb329b2-c60b-44d4-890b-03276773cc69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846450399cf4e448d7f9c6b0edf0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:34Z,use_quota=True,user_id='f209c8aa8ee8419f8314a053f22eb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Creating volume 0cb329b2-c60b-44d4-890b-03276773cc69 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:37 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc5a3a7-c9ca-468b-9a37-4a5cb3c0e30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db71b01-f787-4616-bd63-f27cc7d60712', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e2c574-e20f-4cdc-9cad-a73dce301d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:37 devstack sudo[112753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69 1073741824 Aug 01 15:23:37 devstack sudo[112753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fa896a38-0784-4837-9333-a121a5c3a5ae tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-c77b098c-41a6-4581-a512-8c3a4f71ef8a-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:37 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Volume volume-0db71b01-f787-4616-bd63-f27cc7d60712 (0db71b01-f787-4616-bd63-f27cc7d60712): created successfully Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e2c574-e20f-4cdc-9cad-a73dce301d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Flow 'volume_create_manager' (4c82e335-3aa0-4854-ab0e-58b06d629a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:37 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b61ef798-3f0b-4006-8f2e-0461e4b4a47c tempest-CreateVolumesFromImageTest-1740936655 None] Created volume successfully. Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-77476085-19b2-48e2-b1e0-46b5d975c794-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-77476085-19b2-48e2-b1e0-46b5d975c794-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-quobyte-77476085-19b2-48e2-b1e0-46b5d975c794" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-77476085-19b2-48e2-b1e0-46b5d975c794" acquired by "delete_volume" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[21959492-0312-4275-af0b-153cc1d35c8a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:37 devstack sudo[112753]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69 1073741824" returned: 0 in 0.630s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:37 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69 Aug 01 15:23:37 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:37 devstack sudo[112759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794 Aug 01 15:23:37 devstack sudo[112759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:37 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69" returned: 0 in 0.277s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.151s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1800999343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d80f61-55a6-4051-84a1-42a166fe70d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846450399cf4e448d7f9c6b0edf0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:35Z,use_quota=True,user_id='f209c8aa8ee8419f8314a053f22eb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Creating volume 44d80f61-55a6-4051-84a1-42a166fe70d9 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:37 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce4cb1ee-467f-420d-bcf7-7e7b27886e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb329b2-c60b-44d4-890b-03276773cc69', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c22d3fa-19cc-44d5-b0cb-99a80dd7e614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:38 devstack sudo[112766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9 1073741824 Aug 01 15:23:38 devstack sudo[112766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:38 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Volume volume-0cb329b2-c60b-44d4-890b-03276773cc69 (0cb329b2-c60b-44d4-890b-03276773cc69): created successfully Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c22d3fa-19cc-44d5-b0cb-99a80dd7e614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Flow 'volume_create_manager' (0290f8cd-51aa-4105-a9ee-5f9abc3c60db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:38 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-23d9cf43-17d2-43d3-8d59-c9f1e5cd0c1f tempest-CreateVolumesFromImageTest-1740936655 None] Created volume successfully. Aug 01 15:23:38 devstack sudo[112759]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794" returned: 0 in 0.447s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:38 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794 Aug 01 15:23:38 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:38 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-77476085-19b2-48e2-b1e0-46b5d975c794" returned: 0 in 0.279s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-77476085-19b2-48e2-b1e0-46b5d975c794" released by "delete_volume" :: held 0.770s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Created reservations ['563ca038-604a-4e40-aaec-4627b52dd63e', '1a520c90-666e-47a9-aa52-d86f988cf6d1', '8e40c9dc-8da7-43a6-8a15-cb3379de4ad6', '83de361d-ef62-4b8a-8587-d8e59542537f'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:38 devstack sudo[112766]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9 1073741824" returned: 0 in 0.709s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:38 devstack sudo[112776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:38 devstack sudo[112776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-a0872952-d126-4c43-9b2b-e9b5913705e3-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-a0872952-d126-4c43-9b2b-e9b5913705e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-quobyte-c94ce170-f41a-48f1-bb64-b7a059e9f811" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:38 devstack sudo[112778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9 Aug 01 15:23:38 devstack sudo[112778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-c94ce170-f41a-48f1-bb64-b7a059e9f811" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-quobyte-a0872952-d126-4c43-9b2b-e9b5913705e3" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-a0872952-d126-4c43-9b2b-e9b5913705e3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Deleting offline snapshot a0872952-d126-4c43-9b2b-e9b5913705e3 of volume c94ce170-f41a-48f1-bb64-b7a059e9f811 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] snapshot_file for this snap is: volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9208b1db-3a59-4f28-8f11-53c817578314]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:39 devstack sudo[112776]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.416s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:39 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Deleted volume successfully. Aug 01 15:23:39 devstack sudo[112778]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:39 devstack sudo[112780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 Aug 01 15:23:39 devstack sudo[112780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9" returned: 0 in 0.356s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.531s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1819315219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e783698-db3d-4d82-90aa-ac948f62d86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846450399cf4e448d7f9c6b0edf0ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:35Z,use_quota=True,user_id='f209c8aa8ee8419f8314a053f22eb52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Creating volume 2e783698-db3d-4d82-90aa-ac948f62d86a {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:39 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af0c4b7-777c-44ad-b7c8-9f729c3658af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d80f61-55a6-4051-84a1-42a166fe70d9', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53662af9-df99-478a-951b-4e0af2f49b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:39 devstack sudo[112784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a 1073741824 Aug 01 15:23:39 devstack sudo[112784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-49632621-1796-4351-80d1-7918d01e2fa1 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-77476085-19b2-48e2-b1e0-46b5d975c794-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:39 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Volume volume-44d80f61-55a6-4051-84a1-42a166fe70d9 (44d80f61-55a6-4051-84a1-42a166fe70d9): created successfully Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53662af9-df99-478a-951b-4e0af2f49b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Flow 'volume_create_manager' (9a5596d0-4a4a-468d-a057-86563c3e7656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:39 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6aa3e238-2797-42a4-a32d-9b8516cb0f3d tempest-CreateVolumesFromImageTest-1740936655 None] Created volume successfully. Aug 01 15:23:39 devstack sudo[112780]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3" returned: 0 in 0.523s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c94ce170-f41a-48f1-bb64-b7a059e9f811(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcddad87-2014-4edf-bacb-a4140d68eb26]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:39 devstack sudo[112792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 Aug 01 15:23:39 devstack sudo[112792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:39 devstack sudo[112784]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a 1073741824" returned: 0 in 0.641s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:39 devstack sudo[112796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a Aug 01 15:23:39 devstack sudo[112796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:39 devstack sudo[112792]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811" returned: 0 in 0.470s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:39 devstack sudo[112802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 Aug 01 15:23:39 devstack sudo[112802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:40 devstack sudo[112796]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a" returned: 0 in 0.291s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.053s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:40 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Cloning volume 15ab782f-c9d8-47cb-a27e-6a0be61f9b58 to volume e3dbb29d-797a-4e72-8a94-e365c7d5c60d Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f08e92-b5ee-45a6-a9ca-6fbffbfac2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e783698-db3d-4d82-90aa-ac948f62d86a', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b861d4e-664f-4038-b25a-abf9c2494e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:40 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Volume volume-2e783698-db3d-4d82-90aa-ac948f62d86a (2e783698-db3d-4d82-90aa-ac948f62d86a): created successfully Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b861d4e-664f-4038-b25a-abf9c2494e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Flow 'volume_create_manager' (07678c49-7e18-4bd0-bed8-fba2aa229c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Creating offline snapshot cd3655ef-d063-48c0-a4cc-1729e609c24e of volume 15ab782f-c9d8-47cb-a27e-6a0be61f9b58 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:23:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c4169049-0b43-4cf9-ba62-b4069e9aa331 tempest-CreateVolumesFromImageTest-1740936655 None] Created volume successfully. Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c734654a-da62-4c6b-9d6f-1cd5a99845c8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:40 devstack sudo[112802]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3" returned: 0 in 0.398s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:40 devstack sudo[112809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 Aug 01 15:23:40 devstack sudo[112809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:40 devstack sudo[112810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3 Aug 01 15:23:40 devstack sudo[112810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:40 devstack sudo[112810]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811.a0872952-d126-4c43-9b2b-e9b5913705e3" returned: 0 in 0.278s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:40 devstack sudo[112809]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" returned: 0 in 0.456s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-a0872952-d126-4c43-9b2b-e9b5913705e3" released by "_delete_snapshot" :: held 1.817s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-c94ce170-f41a-48f1-bb64-b7a059e9f811" released by "delete_snapshot" :: held 1.852s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:40 devstack sudo[112820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e 1G Aug 01 15:23:40 devstack sudo[112820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Created reservations ['0f33a772-ff3b-4d2c-8bc5-f3d122557cc6', '12196b0b-65e6-4019-8403-1239d1de11f8', '4de82274-c7cb-47f6-b596-9b4fcaa3ad34', 'b06f5919-e28e-4fb5-9b49-aea7e49c3f1e'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Delete snapshot completed successfully. Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09a55198-47f7-4f1b-8579-eb32925785a4 tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-a0872952-d126-4c43-9b2b-e9b5913705e3-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "cinder-2e783698-db3d-4d82-90aa-ac948f62d86a-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-2e783698-db3d-4d82-90aa-ac948f62d86a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-c94ce170-f41a-48f1-bb64-b7a059e9f811-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-c94ce170-f41a-48f1-bb64-b7a059e9f811-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "cinder-quobyte-2e783698-db3d-4d82-90aa-ac948f62d86a" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-quobyte-2e783698-db3d-4d82-90aa-ac948f62d86a" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "cinder-quobyte-c94ce170-f41a-48f1-bb64-b7a059e9f811" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7500391e-3f13-4970-a0c1-78af2c8ba416]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-c94ce170-f41a-48f1-bb64-b7a059e9f811" acquired by "delete_volume" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d5cac1-7c77-458e-b718-af496f947d20]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:41 devstack sudo[112820]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e 1G" returned: 0 in 0.585s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:41 devstack sudo[112825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a Aug 01 15:23:41 devstack sudo[112825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:41 devstack sudo[112827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e Aug 01 15:23:41 devstack sudo[112827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:41 devstack sudo[112826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 Aug 01 15:23:41 devstack sudo[112826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:41 devstack sudo[112825]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a" returned: 0 in 0.401s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:41 devstack sudo[112837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a Aug 01 15:23:41 devstack sudo[112837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:41 devstack sudo[112827]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e" returned: 0 in 0.380s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:41 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e is being set with open permissions: ugo+rw Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:41 devstack sudo[112841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e Aug 01 15:23:41 devstack sudo[112841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:41 devstack sudo[112826]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811" returned: 0 in 0.500s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:41 devstack sudo[112844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811 Aug 01 15:23:41 devstack sudo[112844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:41 devstack sudo[112837]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2e783698-db3d-4d82-90aa-ac948f62d86a" returned: 0 in 0.315s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-quobyte-2e783698-db3d-4d82-90aa-ac948f62d86a" released by "delete_volume" :: held 0.773s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:41 devstack sudo[112841]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e" returned: 0 in 0.281s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:41 devstack sudo[112848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.info Aug 01 15:23:41 devstack sudo[112848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:41 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Created reservations ['6797b3f4-8a8e-4d06-b9e0-07711939099c', '7b7379cb-7c72-4add-8bcf-be1d7cb43e2d', '2404db4f-3f0b-4b0c-ba44-a9740df46d6d', '9c938e6b-2f29-47d5-8616-6614285bcb65'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:42 devstack sudo[112844]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c94ce170-f41a-48f1-bb64-b7a059e9f811" returned: 0 in 0.324s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-quobyte-c94ce170-f41a-48f1-bb64-b7a059e9f811" released by "delete_volume" :: held 0.900s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:42 devstack sudo[112851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:42 devstack sudo[112851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Created reservations ['30de871b-5bcb-42fe-958e-c4ac71977546', 'd1b2e70b-6fbe-4ddf-a89e-80c7274146a0', '23277643-25a3-4712-bc50-d7a02daed05b', '7063a1b9-867f-4b12-8fae-e7c58c149e33'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "cinder-44d80f61-55a6-4051-84a1-42a166fe70d9-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:42 devstack sudo[112848]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-44d80f61-55a6-4051-84a1-42a166fe70d9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.info" returned: 0 in 0.375s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:42 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.info is being set with open permissions: ugo+rw Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:42 devstack sudo[112854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.info Aug 01 15:23:42 devstack sudo[112854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "cinder-quobyte-44d80f61-55a6-4051-84a1-42a166fe70d9" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-quobyte-44d80f61-55a6-4051-84a1-42a166fe70d9" acquired by "delete_volume" :: waited 0.045s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:42 devstack sudo[112856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:42 devstack sudo[112856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[be16ced3-d186-4514-a78b-9402a65175c1]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:42 devstack sudo[112854]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.info" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:42 devstack sudo[112851]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:42 devstack sudo[112858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9 Aug 01 15:23:42 devstack sudo[112858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-e3dbb29d-797a-4e72-8a94-e365c7d5c60d" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.553s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Deleted volume successfully. Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-e3dbb29d-797a-4e72-8a94-e365c7d5c60d" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] snapshot: cd3655ef-d063-48c0-a4cc-1729e609c24e, volume: e3dbb29d-797a-4e72-8a94-e365c7d5c60d, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d962ed1c-5519-4320-96f8-b30065e0b8dc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-627750cf-5336-4449-86a7-371830ec2c6e tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-2e783698-db3d-4d82-90aa-ac948f62d86a-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:42 devstack sudo[112856]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.395s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Deleted volume successfully. Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b98a415a-7c87-4dd4-9bb1-031ad1c71dab tempest-CreateVolumesFromSnapshotTest-974106271 None] Lock "cinder-c94ce170-f41a-48f1-bb64-b7a059e9f811-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:42 devstack sudo[112862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e Aug 01 15:23:42 devstack sudo[112862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:42 devstack sudo[112858]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9" returned: 0 in 0.492s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:43 devstack sudo[112868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9 Aug 01 15:23:43 devstack sudo[112868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:43 devstack sudo[112862]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e" returned: 0 in 0.444s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bddba9-fead-4816-9109-09a0a11e3dcf]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:43 devstack sudo[112868]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-44d80f61-55a6-4051-84a1-42a166fe70d9" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-quobyte-44d80f61-55a6-4051-84a1-42a166fe70d9" released by "delete_volume" :: held 0.854s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:43 devstack sudo[112873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 Aug 01 15:23:43 devstack sudo[112873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Created reservations ['3884b0c0-7459-4568-982d-e0ff03a21fa9', '1fc3846f-5d34-4f15-81ce-c4b971fc109d', 'ec5104e7-dafd-4fff-bb9b-f381b6e99715', '99cbac3c-cc5f-4574-8aeb-fea9c8b9645f'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:43 devstack sudo[112876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:43 devstack sudo[112876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "cinder-0cb329b2-c60b-44d4-890b-03276773cc69-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-0cb329b2-c60b-44d4-890b-03276773cc69-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "cinder-quobyte-0cb329b2-c60b-44d4-890b-03276773cc69" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-quobyte-0cb329b2-c60b-44d4-890b-03276773cc69" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12fac47-f4d3-4ba7-86da-96261905718f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:43 devstack sudo[112873]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" returned: 0 in 0.541s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:23:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:43 devstack sudo[112882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d Aug 01 15:23:43 devstack sudo[112882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:43 devstack sudo[112881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69 Aug 01 15:23:43 devstack sudo[112881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:44 devstack sudo[112876]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.541s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:44 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Deleted volume successfully. Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-f4e3b4b1-3f7e-4c9e-a17c-2e66a3b9f8ce tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-44d80f61-55a6-4051-84a1-42a166fe70d9-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:44 devstack sudo[112881]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69" returned: 0 in 0.478s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:44 devstack sudo[112893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69 Aug 01 15:23:44 devstack sudo[112893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:44 devstack sudo[112882]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d" returned: 0 in 0.733s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:23:44 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 01 15:23:44 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d is being set with open permissions: ugo+rw Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:44 devstack sudo[112896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d Aug 01 15:23:44 devstack sudo[112896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:44 devstack sudo[112893]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0cb329b2-c60b-44d4-890b-03276773cc69" returned: 0 in 0.427s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-quobyte-0cb329b2-c60b-44d4-890b-03276773cc69" released by "delete_volume" :: held 0.968s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Created reservations ['0fd32ab4-ed20-4e89-b306-9de8270d6fdb', '97905b33-ca9e-4c68-aed4-249f26a7e896', '5a3f272d-11e0-4744-b03e-84dd4cf5bc3d', '8caaabc8-ebe3-4715-9b29-eb86828f6524'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:44 devstack sudo[112896]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d" returned: 0 in 0.332s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-e3dbb29d-797a-4e72-8a94-e365c7d5c60d" released by "_copy_volume_from_snapshot" :: held 2.139s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-cd3655ef-d063-48c0-a4cc-1729e609c24e" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:44 devstack sudo[112900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:44 devstack sudo[112900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-cd3655ef-d063-48c0-a4cc-1729e609c24e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Deleting offline snapshot cd3655ef-d063-48c0-a4cc-1729e609c24e of volume 15ab782f-c9d8-47cb-a27e-6a0be61f9b58 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] snapshot_file for this snap is: volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f921d150-2b69-4766-9ef9-3d6c69b3980d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:45 devstack sudo[112903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e Aug 01 15:23:45 devstack sudo[112903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:45 devstack sudo[112900]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.400s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Deleted volume successfully. Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0a7a9a28-6375-4c24-9b53-0a5dfd78d181 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-0cb329b2-c60b-44d4-890b-03276773cc69-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:45 devstack sudo[112903]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e" returned: 0 in 0.509s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09a6b2c-4788-4e8c-8fef-d043fdd2d0e6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:45 devstack sudo[112909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 Aug 01 15:23:45 devstack sudo[112909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "cinder-0db71b01-f787-4616-bd63-f27cc7d60712-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:45 devstack sudo[112909]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-0db71b01-f787-4616-bd63-f27cc7d60712-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" returned: 0 in 0.422s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:45 devstack sudo[112914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e Aug 01 15:23:45 devstack sudo[112914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "cinder-quobyte-0db71b01-f787-4616-bd63-f27cc7d60712" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-quobyte-0db71b01-f787-4616-bd63-f27cc7d60712" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c981b68c-5ebd-4f6d-89fb-5c32be55d22d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:46 devstack sudo[112916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712 Aug 01 15:23:46 devstack sudo[112916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:46 devstack sudo[112914]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e" returned: 0 in 0.447s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:46 devstack sudo[112922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e Aug 01 15:23:46 devstack sudo[112922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:46 devstack sudo[112916]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712" returned: 0 in 0.503s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:46 devstack sudo[112930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712 Aug 01 15:23:46 devstack sudo[112930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:46 devstack sudo[112922]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58.cd3655ef-d063-48c0-a4cc-1729e609c24e" returned: 0 in 0.311s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-cd3655ef-d063-48c0-a4cc-1729e609c24e" released by "_delete_snapshot" :: held 1.826s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 6.654s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dc0522-46dc-44fd-a269-cd4f6c482c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d', 'volume_size': 1, 'source_volid': '15ab782f-c9d8-47cb-a27e-6a0be61f9b58', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3220e06b-7e0f-42ea-9638-57ddbb94e355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Volume volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d (e3dbb29d-797a-4e72-8a94-e365c7d5c60d): created successfully Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3220e06b-7e0f-42ea-9638-57ddbb94e355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (8ff5c1c8-25c6-40ad-a834-c1fca4d48ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:46 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-046d9e95-a987-4a9e-b029-1d4474c39b2d tempest-VolumeDependencyTests-841441038 None] Created volume successfully. Aug 01 15:23:46 devstack sudo[112930]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0db71b01-f787-4616-bd63-f27cc7d60712" returned: 0 in 0.343s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-quobyte-0db71b01-f787-4616-bd63-f27cc7d60712" released by "delete_volume" :: held 0.903s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:46 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Created reservations ['977e4818-7306-4a3b-9ecf-9d528c552727', 'f609bdd0-e374-49f7-b730-cd67bfd61e38', '1f811063-f9d5-4bbe-ba6c-a38037ea426e', 'f9575310-1be4-4a24-b756-8f639992cf91'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:47 devstack sudo[112934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:47 devstack sudo[112934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "cinder-0c03c129-28aa-4022-b8be-45fa7ba13977-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-0c03c129-28aa-4022-b8be-45fa7ba13977-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "cinder-quobyte-0c03c129-28aa-4022-b8be-45fa7ba13977" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-quobyte-0c03c129-28aa-4022-b8be-45fa7ba13977" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cd1b51-2546-473b-a0ac-b7eab92557d8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:47 devstack sudo[112934]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.323s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Deleted volume successfully. Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-3f432ca7-4ee8-46d0-a3cb-b87271aa0614 tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-0db71b01-f787-4616-bd63-f27cc7d60712-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:47 devstack sudo[112936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977 Aug 01 15:23:47 devstack sudo[112936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-96a6309f-4ed1-4087-aa4d-349c0227e8ec-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-96a6309f-4ed1-4087-aa4d-349c0227e8ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-f8baaee3-db81-4206-93d8-7766e3bc8c91" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-f8baaee3-db81-4206-93d8-7766e3bc8c91" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-96a6309f-4ed1-4087-aa4d-349c0227e8ec" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-96a6309f-4ed1-4087-aa4d-349c0227e8ec" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Deleting offline snapshot 96a6309f-4ed1-4087-aa4d-349c0227e8ec of volume f8baaee3-db81-4206-93d8-7766e3bc8c91 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] snapshot_file for this snap is: volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fbe007-5e08-44a6-85ca-d093653ee3a2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:47 devstack sudo[112936]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977" returned: 0 in 0.565s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:47 devstack sudo[112943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977 Aug 01 15:23:47 devstack sudo[112943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:47 devstack sudo[112942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec Aug 01 15:23:47 devstack sudo[112942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:48 devstack sudo[112943]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0c03c129-28aa-4022-b8be-45fa7ba13977" returned: 0 in 0.313s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-quobyte-0c03c129-28aa-4022-b8be-45fa7ba13977" released by "delete_volume" :: held 0.936s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Created reservations ['8bb4c5bc-f324-4bc1-a5c1-14896d62fcfd', 'db7cc94b-cfde-42af-9bfd-fdbae1428381', '238d031c-1b0a-4144-b019-c0dea199625b', '3fcaf599-f613-449a-b014-ab3d5af25d99'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:48 devstack sudo[112942]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec" returned: 0 in 0.540s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8baaee3-db81-4206-93d8-7766e3bc8c91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de1527d-27dc-487b-9065-aafcb81f7d9e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:48 devstack sudo[112951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:48 devstack sudo[112951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:48 devstack sudo[112950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 Aug 01 15:23:48 devstack sudo[112950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:48 devstack sudo[112951]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.333s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Deleted volume successfully. Aug 01 15:23:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8aaa085e-2618-471d-ae1b-6689ba4c0f1a tempest-CreateVolumesFromImageTest-1740936655 None] Lock "cinder-0c03c129-28aa-4022-b8be-45fa7ba13977-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:49 devstack sudo[112950]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91" returned: 0 in 0.851s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:49 devstack sudo[112962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec Aug 01 15:23:49 devstack sudo[112962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:49 devstack sudo[112962]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec" returned: 0 in 0.438s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:49 devstack sudo[112978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec Aug 01 15:23:49 devstack sudo[112978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:50 devstack sudo[112978]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91.96a6309f-4ed1-4087-aa4d-349c0227e8ec" returned: 0 in 0.411s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-96a6309f-4ed1-4087-aa4d-349c0227e8ec" released by "_delete_snapshot" :: held 2.392s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-f8baaee3-db81-4206-93d8-7766e3bc8c91" released by "delete_snapshot" :: held 2.420s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:50 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Created reservations ['c17aa609-c26a-4c5c-a2fb-b398fb23fca1', '43197942-1800-4577-bfd9-f15a406e87a4', 'b1fcfbcd-afd8-4178-b407-c359a0b9a41e', '530b305e-070d-4ed9-b7e4-71ecd90c6c8c'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Delete snapshot completed successfully. Aug 01 15:23:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d6aae8e4-2734-4f86-9832-26faf393e6d6 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-96a6309f-4ed1-4087-aa4d-349c0227e8ec-delete_snapshot" released by "delete_snapshot" :: held 2.611s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-1a9893a8-2626-48cc-a5dc-25cae6fcad36-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Lock "cinder-1a9893a8-2626-48cc-a5dc-25cae6fcad36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-6690bfa7-ec7b-47b7-970d-5c83310c06ab" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-6690bfa7-ec7b-47b7-970d-5c83310c06ab" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-1a9893a8-2626-48cc-a5dc-25cae6fcad36" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-1a9893a8-2626-48cc-a5dc-25cae6fcad36" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Deleting offline snapshot 1a9893a8-2626-48cc-a5dc-25cae6fcad36 of volume 6690bfa7-ec7b-47b7-970d-5c83310c06ab {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] snapshot_file for this snap is: volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1893e8c0-791a-4dbc-aa19-958d5b50484c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:51 devstack sudo[112984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 Aug 01 15:23:51 devstack sudo[112984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Flow 'volume_create_manager' (e2e05ba2-0889-4d66-9c72-a37499ba3048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02e98c9-fe29-4117-9414-abe4af8c2152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02e98c9-fe29-4117-9414-abe4af8c2152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb8786a-2970-4dba-a435-a712d508d8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af2e0ac207a45e6805ffa6c60bc79c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:51Z,use_quota=True,user_id='ab05d4fdd2684209bf3a1016b2141261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05816532-d022-4592-bb7f-bf0a6af377c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05816532-d022-4592-bb7f-bf0a6af377c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d1d64c-794a-44e1-b057-cd1bbb68f101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:23:51 devstack sudo[112984]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36" returned: 0 in 0.633s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c590bd-84ac-44f5-ad56-fc266aed5046]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:51 devstack sudo[112989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab Aug 01 15:23:51 devstack sudo[112989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d1d64c-794a-44e1-b057-cd1bbb68f101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bdb8786a-2970-4dba-a435-a712d508d8b0', 'volume_name': 'volume-bdb8786a-2970-4dba-a435-a712d508d8b0', 'volume_size': 1, 'image_id': 'eb573a49-af16-4ac9-9f93-97c1102b000c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb573a49-af16-4ac9-9f93-97c1102b000c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '859d84c7374abf54a7dc5b3f1512cdee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af2e0ac207a45e6805ffa6c60bc79c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cb0603bb5fcf4c9d93df96612a753cebfef6cf1a68b86c1d062c3d0cce0b5f86f5f18eb972344bc138ee76bf32130fa92615f43a95149cab16b2ab60f4bc3c61', 'id': 'eb573a49-af16-4ac9-9f93-97c1102b000c', 'created_at': datetime.datetime(2026, 8, 1, 13, 23, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 23, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb573a49-af16-4ac9-9f93-97c1102b000c/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0011816-f480-4629-bba2-915d6bfb20c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0011816-f480-4629-bba2-915d6bfb20c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69d54fc-abb8-4772-a7ca-e97951f4b1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Volume bdb8786a-2970-4dba-a435-a712d508d8b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bdb8786a-2970-4dba-a435-a712d508d8b0', 'volume_size': 1, 'image_id': 'eb573a49-af16-4ac9-9f93-97c1102b000c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb573a49-af16-4ac9-9f93-97c1102b000c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '859d84c7374abf54a7dc5b3f1512cdee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af2e0ac207a45e6805ffa6c60bc79c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cb0603bb5fcf4c9d93df96612a753cebfef6cf1a68b86c1d062c3d0cce0b5f86f5f18eb972344bc138ee76bf32130fa92615f43a95149cab16b2ab60f4bc3c61', 'id': 'eb573a49-af16-4ac9-9f93-97c1102b000c', 'created_at': datetime.datetime(2026, 8, 1, 13, 23, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 23, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb573a49-af16-4ac9-9f93-97c1102b000c/file', 'properties': {}}, 'image_service': } Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Trying to clone bdb8786a-2970-4dba-a435-a712d508d8b0 from image eb573a49-af16-4ac9-9f93-97c1102b000c at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb573a49-af16-4ac9-9f93-97c1102b000c', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:23:52 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Image download 0.00 MB at 0.00 MB/s Aug 01 15:23:52 devstack sudo[112989]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb47e41-bb3a-4508-91e2-50003d05d5ea]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab" returned: 0 in 0.470s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:52 devstack sudo[112996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 Aug 01 15:23:52 devstack sudo[112996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:52 devstack sudo[112995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD Aug 01 15:23:52 devstack sudo[112995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:52 devstack sudo[112995]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:52 devstack sudo[112996]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36" returned: 0 in 0.641s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:52 devstack sudo[113018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36 Aug 01 15:23:52 devstack sudo[113018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:53 devstack sudo[113013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD Aug 01 15:23:53 devstack sudo[113013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:53 devstack sudo[113013]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD" returned: 1 in 0.561s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:23:53 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Temporary image eb573a49-af16-4ac9-9f93-97c1102b000c is fetched for user ab05d4fdd2684209bf3a1016b2141261. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:23:53 devstack sudo[113018]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab.1a9893a8-2626-48cc-a5dc-25cae6fcad36" returned: 0 in 0.534s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-1a9893a8-2626-48cc-a5dc-25cae6fcad36" released by "_delete_snapshot" :: held 2.460s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:53 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[630db35e-de5b-44e2-a582-ac785f8d70ee]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-6690bfa7-ec7b-47b7-970d-5c83310c06ab" released by "delete_snapshot" :: held 2.521s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:53 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Created reservations ['b63e5264-e18a-4f96-a9b8-4338adc739bb', 'ad2fbb80-d2b5-4690-b938-3578ee9f54bc', '03f90bf0-43cc-43f5-b10a-a62bc033c45b', '59798264-5d51-414f-a51c-e19d644f8030'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Delete snapshot completed successfully. Aug 01 15:23:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec8c99bc-5ae2-4f26-8d9b-a8b9d52209de tempest-VolumeDependencyTests-841441038 None] Lock "cinder-1a9893a8-2626-48cc-a5dc-25cae6fcad36-delete_snapshot" released by "delete_snapshot" :: held 2.815s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:53 devstack sudo[113052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD Aug 01 15:23:53 devstack sudo[113052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:54 devstack sudo[113052]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD" returned: 0 in 0.685s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-15ab782f-c9d8-47cb-a27e-6a0be61f9b58-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Lock "cinder-15ab782f-c9d8-47cb-a27e-6a0be61f9b58-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:54 devstack sudo[113082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD Aug 01 15:23:54 devstack sudo[113082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[511f128f-9606-4cfd-aaa2-2eade58073f3]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (601d039c-b154-4a0d-bf4d-d89d58c3c803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5518db-ec9e-49a8-b40d-6f8e8ed7549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be5518db-ec9e-49a8-b40d-6f8e8ed7549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-913989572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:54Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399b7190-fea6-4867-9a78-2ee802358986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399b7190-fea6-4867-9a78-2ee802358986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932d4aca-2a8e-48ae-976f-fe1582ae1bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932d4aca-2a8e-48ae-976f-fe1582ae1bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9', 'volume_name': 'volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31eadb9-988d-4e98-af5f-aa85c85caa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31eadb9-988d-4e98-af5f-aa85c85caa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59a7c2f-439d-45a6-b33c-8b10c3a9b8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:54 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9', 'volume_size': 1} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-913989572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:54Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Creating volume b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:54 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:54 devstack sudo[113097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 Aug 01 15:23:54 devstack sudo[113097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:54 devstack sudo[113082]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD" returned: 1 in 0.585s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:23:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:54 devstack sudo[113103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9 1073741824 Aug 01 15:23:54 devstack sudo[113103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:55 devstack sudo[113097]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" returned: 0 in 0.526s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:55 devstack sudo[113113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58 Aug 01 15:23:55 devstack sudo[113113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:55 devstack sudo[113103]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9 1073741824" returned: 0 in 0.490s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:55 devstack sudo[113115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9 Aug 01 15:23:55 devstack sudo[113115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:55 devstack sudo[113113]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" returned: 0 in 0.272s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-15ab782f-c9d8-47cb-a27e-6a0be61f9b58" released by "delete_volume" :: held 0.893s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Created reservations ['5e3dbe3d-6fda-455b-9e1d-4136eff202c6', '6dadc1ba-5007-48f0-bd19-46cd7fca565e', 'fd472ba8-cf26-419b-b8f1-cec5a4d00c26', '58485b2d-9f0b-43cc-a528-b239d182abec'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:55 devstack sudo[113121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:55 devstack sudo[113121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:55 devstack sudo[113115]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9" returned: 0 in 0.333s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.847s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdb8786a-2970-4dba-a435-a712d508d8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af2e0ac207a45e6805ffa6c60bc79c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:51Z,use_quota=True,user_id='ab05d4fdd2684209bf3a1016b2141261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Creating volume bdb8786a-2970-4dba-a435-a712d508d8b0 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:55 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-f8baaee3-db81-4206-93d8-7766e3bc8c91-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:55 devstack sudo[113123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 1073741824 Aug 01 15:23:55 devstack sudo[113123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59a7c2f-439d-45a6-b33c-8b10c3a9b8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c7fc41-fde0-46b2-8263-78f556585866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-f8baaee3-db81-4206-93d8-7766e3bc8c91-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:55 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9 (b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9): created successfully Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c7fc41-fde0-46b2-8263-78f556585866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:55 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (601d039c-b154-4a0d-bf4d-d89d58c3c803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d748b907-7ee4-4532-bd1e-c0b454834974 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created volume successfully. Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-f8baaee3-db81-4206-93d8-7766e3bc8c91" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-f8baaee3-db81-4206-93d8-7766e3bc8c91" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7a1a6f-6a45-4039-abef-8b9ca199fcc2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:56 devstack sudo[113125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 Aug 01 15:23:56 devstack sudo[113125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:56 devstack sudo[113121]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.758s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Deleted volume successfully. Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40e3ba3f-77c2-4f12-8210-c4a3226e3a0c tempest-VolumeDependencyTests-841441038 None] Lock "cinder-15ab782f-c9d8-47cb-a27e-6a0be61f9b58-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:56 devstack sudo[113123]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 1073741824" returned: 0 in 0.890s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:56 devstack sudo[113125]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91" returned: 0 in 0.480s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:56 devstack sudo[113135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 Aug 01 15:23:56 devstack sudo[113135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:56 devstack sudo[113136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91 Aug 01 15:23:56 devstack sudo[113136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:56 devstack sudo[113135]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0" returned: 0 in 0.271s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:56 devstack sudo[113136]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Attempting download of eb573a49-af16-4ac9-9f93-97c1102b000c ((None, [{'url': 'file:///opt/stack/data/glance/images/eb573a49-af16-4ac9-9f93-97c1102b000c', 'metadata': {}}])) to volume bdb8786a-2970-4dba-a435-a712d508d8b0. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f8baaee3-db81-4206-93d8-7766e3bc8c91" returned: 0 in 0.328s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-f8baaee3-db81-4206-93d8-7766e3bc8c91" released by "delete_volume" :: held 0.913s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f8dd6c-b5aa-4dd1-a4e8-d99d8094d2fa]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb573a49-af16-4ac9-9f93-97c1102b000c_lpxis645 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Created reservations ['8d138b80-41a3-4340-b18b-c715447b013c', '03753bab-165b-4848-8a2e-191276e796a9', '564725bd-f2c1-4dd2-89c9-059b6ccf2496', '397cce68-0114-4076-807b-50a8867f7906'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:57 devstack sudo[113141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb573a49-af16-4ac9-9f93-97c1102b000c_lpxis645 Aug 01 15:23:57 devstack sudo[113141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:57 devstack sudo[113143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:23:57 devstack sudo[113143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:57 devstack sudo[113143]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:23:57 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Deleted volume successfully. Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5851c441-2756-4538-9e9a-9997734f74c7 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-f8baaee3-db81-4206-93d8-7766e3bc8c91-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:23:57 devstack sudo[113141]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb573a49-af16-4ac9-9f93-97c1102b000c_lpxis645" returned: 0 in 0.656s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb573a49-af16-4ac9-9f93-97c1102b000c_lpxis645 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (0d001baa-63c4-4ade-ac39-d646132c3dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f525d051-55aa-4c12-980f-7fd91cf52ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f525d051-55aa-4c12-980f-7fd91cf52ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1991276056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:58Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f512140-6568-47ee-a4ae-40ad247ac4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f512140-6568-47ee-a4ae-40ad247ac4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beee06ba-d98a-4cb6-9b1d-f2ad1c3ab3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beee06ba-d98a-4cb6-9b1d-f2ad1c3ab3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa', 'volume_name': 'volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd824f50-a8d4-43e4-8aa0-13a802dcce03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd824f50-a8d4-43e4-8aa0-13a802dcce03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a629278-3c69-442a-b21e-e1916884047c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:57 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa', 'volume_size': 1} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1991276056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:58Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Creating volume ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:57 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:57 devstack sudo[113149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa 1073741824 Aug 01 15:23:57 devstack sudo[113149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:57 devstack sudo[113148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb573a49-af16-4ac9-9f93-97c1102b000c_lpxis645 Aug 01 15:23:58 devstack sudo[113148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-6690bfa7-ec7b-47b7-970d-5c83310c06ab-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-6690bfa7-ec7b-47b7-970d-5c83310c06ab-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:58 devstack sudo[113148]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb573a49-af16-4ac9-9f93-97c1102b000c_lpxis645" returned: 1 in 0.704s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb573a49-af16-4ac9-9f93-97c1102b000c_lpxis645' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-6690bfa7-ec7b-47b7-970d-5c83310c06ab" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d4704e-dafb-41c4-92b7-02a829e2a39a]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-6690bfa7-ec7b-47b7-970d-5c83310c06ab" acquired by "delete_volume" :: waited 0.041s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d329311-3469-4915-ab48-3c9eec6bf455]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:58 devstack sudo[113154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD Aug 01 15:23:58 devstack sudo[113154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=181,cinder:SELECT=151,cinder:INSERT=47,cinder:DELETE=17 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (0ba6cfa8-4822-4212-bd2b-26527a311db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bf97f7-3fce-4bd5-8b9c-6fd1881ea6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:58 devstack sudo[113156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab Aug 01 15:23:58 devstack sudo[113156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bf97f7-3fce-4bd5-8b9c-6fd1881ea6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-973509491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8353fa8c-dc71-4fcf-b0da-28f7b02d804f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:59Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f57ae8-0bca-4e8d-9444-abbea8dc6a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f57ae8-0bca-4e8d-9444-abbea8dc6a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d163b89-0b0d-4cc0-96bf-36981203f27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d163b89-0b0d-4cc0-96bf-36981203f27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8353fa8c-dc71-4fcf-b0da-28f7b02d804f', 'volume_name': 'volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c15131-696f-4bb0-9905-26b0b08300a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c15131-696f-4bb0-9905-26b0b08300a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391de2e0-126b-48c7-8c43-23ecaf0d19fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:58 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume 8353fa8c-dc71-4fcf-b0da-28f7b02d804f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f', 'volume_size': 1} Aug 01 15:23:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:59 devstack sudo[113149]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa 1073741824" returned: 0 in 1.120s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:59 devstack sudo[113162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa Aug 01 15:23:59 devstack sudo[113162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:59 devstack sudo[113154]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD" returned: 0 in 0.891s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:59 devstack sudo[113156]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab" returned: 0 in 0.998s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:59 devstack sudo[113162]: pam_unix(sudo:session): session closed for user root Aug 01 15:23:59 devstack sudo[113167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD Aug 01 15:23:59 devstack sudo[113167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa" returned: 0 in 0.426s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.589s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-973509491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8353fa8c-dc71-4fcf-b0da-28f7b02d804f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:23:59Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Creating volume 8353fa8c-dc71-4fcf-b0da-28f7b02d804f {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:23:59 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:23:59 devstack sudo[113170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab Aug 01 15:23:59 devstack sudo[113170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:59 devstack sudo[113172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f 1073741824 Aug 01 15:23:59 devstack sudo[113172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a629278-3c69-442a-b21e-e1916884047c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337f5ae6-80bf-4bf9-87c4-49fe5ef75199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:59 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa (ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa): created successfully Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337f5ae6-80bf-4bf9-87c4-49fe5ef75199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (0d001baa-63c4-4ade-ac39-d646132c3dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-50a73e17-6ae9-4b7f-9ff6-0fd659f20ccb tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created volume successfully. Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (d2f1764d-ef00-4136-a107-a2b64d555842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37b935d-ab61-4f51-a146-a4851160fd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37b935d-ab61-4f51-a146-a4851160fd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1456747972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8a95d2-67ca-4f23-bf07-05f092b26047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:00Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e812d3-0976-49f3-93a0-66f45573bd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e812d3-0976-49f3-93a0-66f45573bd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26560f01-6bf4-419a-8e9a-16762b431183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26560f01-6bf4-419a-8e9a-16762b431183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb8a95d2-67ca-4f23-bf07-05f092b26047', 'volume_name': 'volume-fb8a95d2-67ca-4f23-bf07-05f092b26047', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fa513c-8fdb-4256-86ba-af3e8b0923e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fa513c-8fdb-4256-86ba-af3e8b0923e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559098a2-0562-4105-b834-6322a015093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:23:59 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume fb8a95d2-67ca-4f23-bf07-05f092b26047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb8a95d2-67ca-4f23-bf07-05f092b26047', 'volume_size': 1} Aug 01 15:23:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD" returned: 1 in 0.835s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:00 devstack sudo[113167]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] eb573a49-af16-4ac9-9f93-97c1102b000c was raw, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:00 devstack sudo[113182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 Aug 01 15:24:00 devstack sudo[113182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:00 devstack sudo[113172]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f 1073741824" returned: 0 in 0.811s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:00 devstack sudo[113170]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6690bfa7-ec7b-47b7-970d-5c83310c06ab" returned: 0 in 1.012s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:00 devstack sudo[113186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f Aug 01 15:24:00 devstack sudo[113186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-6690bfa7-ec7b-47b7-970d-5c83310c06ab" released by "delete_volume" :: held 2.163s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (f8037d91-244f-40a1-9420-7c5f918c25f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f913620e-e346-4008-85fd-fa5fd7b42492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f913620e-e346-4008-85fd-fa5fd7b42492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-638630477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1858cd30-e31e-4486-9603-0d852acbfd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:01Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c22ae05-982a-4845-9094-8e2957ab7dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c22ae05-982a-4845-9094-8e2957ab7dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4971724-5838-4638-8eb2-02ceafbfe758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4971724-5838-4638-8eb2-02ceafbfe758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1858cd30-e31e-4486-9603-0d852acbfd7f', 'volume_name': 'volume-1858cd30-e31e-4486-9603-0d852acbfd7f', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84416bd0-455a-445c-9159-445bf6ab3b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84416bd0-455a-445c-9159-445bf6ab3b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:01 devstack sudo[113182]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2963ab6-f444-481f-8dce-0172bd0a562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:01 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume 1858cd30-e31e-4486-9603-0d852acbfd7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1858cd30-e31e-4486-9603-0d852acbfd7f', 'volume_size': 1} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0" returned: 0 in 0.908s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb573a49-af16-4ac9-9f93-97c1102b000c_v4tnhv0tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:24:01 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Converted 0.00 MB image at 0.00 MB/s Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Created reservations ['1968acda-fa62-4191-9abe-b92aff3ac237', 'f307b0a3-483b-4056-b0f5-564596f019ba', '6e63fb1f-912b-460d-813a-89c76fb52132', 'e3b65095-ef2e-4dec-af2f-968c2dd4b241'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:01 devstack sudo[113193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 1G Aug 01 15:24:01 devstack sudo[113193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:01 devstack sudo[113186]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f" returned: 0 in 0.667s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1456747972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8a95d2-67ca-4f23-bf07-05f092b26047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:00Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Creating volume fb8a95d2-67ca-4f23-bf07-05f092b26047 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:01 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:01 devstack sudo[113196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047 1073741824 Aug 01 15:24:01 devstack sudo[113196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391de2e0-126b-48c7-8c43-23ecaf0d19fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa196fa-ad5b-44cf-bdef-b0b0bfecb302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:01 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f (8353fa8c-dc71-4fcf-b0da-28f7b02d804f): created successfully Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa196fa-ad5b-44cf-bdef-b0b0bfecb302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (0ba6cfa8-4822-4212-bd2b-26527a311db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:01 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d5bc7560-50a5-44a9-b387-0509d05e6c61 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created volume successfully. Aug 01 15:24:01 devstack sudo[113198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:01 devstack sudo[113198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (e0adbac3-f8cc-4388-97fb-47fb870ecc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:01 devstack sudo[113193]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c7ddab-174a-4ad6-8273-dc408f1fa823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:01 devstack sudo[113198]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 1G" returned: 0 in 0.810s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Downloaded image eb573a49-af16-4ac9-9f93-97c1102b000c ((None, [{'url': 'file:///opt/stack/data/glance/images/eb573a49-af16-4ac9-9f93-97c1102b000c', 'metadata': {}}])) to volume bdb8786a-2970-4dba-a435-a712d508d8b0 successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Temporary image eb573a49-af16-4ac9-9f93-97c1102b000c for user ab05d4fdd2684209bf3a1016b2141261 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Marking volume bdb8786a-2970-4dba-a435-a712d508d8b0 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.508s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c7ddab-174a-4ad6-8273-dc408f1fa823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-396859796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6feb037f-c6ac-492e-94a2-d8ad5e96aa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:02Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be6cda50-256f-41f4-b417-2904e33499ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be6cda50-256f-41f4-b417-2904e33499ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6160cdf4-e0c2-427f-825b-5f77ed2f9d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:01 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6160cdf4-e0c2-427f-825b-5f77ed2f9d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6feb037f-c6ac-492e-94a2-d8ad5e96aa59', 'volume_name': 'volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3119a479-66c5-41ff-9933-2f8d215d10db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3119a479-66c5-41ff-9933-2f8d215d10db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1508c2ac-d6c2-4b37-9583-2f9a92b5ba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:02 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume 6feb037f-c6ac-492e-94a2-d8ad5e96aa59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59', 'volume_size': 1} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Deleted volume successfully. Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-e3dbb29d-797a-4e72-8a94-e365c7d5c60d-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Copying metadata from image eb573a49-af16-4ac9-9f93-97c1102b000c to bdb8786a-2970-4dba-a435-a712d508d8b0. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Creating volume glance metadata for volume bdb8786a-2970-4dba-a435-a712d508d8b0 backed by image eb573a49-af16-4ac9-9f93-97c1102b000c with: {'image_id': 'eb573a49-af16-4ac9-9f93-97c1102b000c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '859d84c7374abf54a7dc5b3f1512cdee', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:24:02 devstack sudo[113196]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4c67b4a8-9ec2-4ab2-be73-d8f76e84ebd3 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-6690bfa7-ec7b-47b7-970d-5c83310c06ab-delete_volume" released by "delete_volume" :: held 3.789s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-e3dbb29d-797a-4e72-8a94-e365c7d5c60d-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047 1073741824" returned: 0 in 0.937s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-e3dbb29d-797a-4e72-8a94-e365c7d5c60d" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-e3dbb29d-797a-4e72-8a94-e365c7d5c60d" acquired by "delete_volume" :: waited 0.043s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:02 devstack sudo[113209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047 Aug 01 15:24:02 devstack sudo[113209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69d54fc-abb8-4772-a7ca-e97951f4b1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdb8786a-2970-4dba-a435-a712d508d8b0', 'volume_size': 1, 'image_id': 'eb573a49-af16-4ac9-9f93-97c1102b000c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb573a49-af16-4ac9-9f93-97c1102b000c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '859d84c7374abf54a7dc5b3f1512cdee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af2e0ac207a45e6805ffa6c60bc79c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cb0603bb5fcf4c9d93df96612a753cebfef6cf1a68b86c1d062c3d0cce0b5f86f5f18eb972344bc138ee76bf32130fa92615f43a95149cab16b2ab60f4bc3c61', 'id': 'eb573a49-af16-4ac9-9f93-97c1102b000c', 'created_at': datetime.datetime(2026, 8, 1, 13, 23, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 23, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb573a49-af16-4ac9-9f93-97c1102b000c/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5607e4-2cec-491b-9c0a-64dff6297751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a74554-1d0a-4d5d-82cb-5bdf60df09d1]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:02 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Volume volume-bdb8786a-2970-4dba-a435-a712d508d8b0 (bdb8786a-2970-4dba-a435-a712d508d8b0): created successfully Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5607e4-2cec-491b-9c0a-64dff6297751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Flow 'volume_create_manager' (e2e05ba2-0889-4d66-9c72-a37499ba3048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-234360a5-1b24-4703-b499-4b28dc52b244 tempest-VolumeImageDependencyTests-696602523 None] Created volume successfully. Aug 01 15:24:02 devstack sudo[113211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d Aug 01 15:24:02 devstack sudo[113211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:02 devstack sudo[113209]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047" returned: 0 in 0.310s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.462s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-638630477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1858cd30-e31e-4486-9603-0d852acbfd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:01Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Creating volume 1858cd30-e31e-4486-9603-0d852acbfd7f {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:02 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559098a2-0562-4105-b834-6322a015093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8a95d2-67ca-4f23-bf07-05f092b26047', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cdc0f3-a26e-4d20-a188-e2cff35919e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:02 devstack sudo[113214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f 1073741824 Aug 01 15:24:02 devstack sudo[113214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:02 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume volume-fb8a95d2-67ca-4f23-bf07-05f092b26047 (fb8a95d2-67ca-4f23-bf07-05f092b26047): created successfully Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cdc0f3-a26e-4d20-a188-e2cff35919e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (d2f1764d-ef00-4136-a107-a2b64d555842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:02 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-51afa6df-6eef-4639-8038-6a2b020ade75 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created volume successfully. Aug 01 15:24:02 devstack sudo[113211]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d" returned: 0 in 0.544s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-bdb8786a-2970-4dba-a435-a712d508d8b0-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:02 devstack sudo[113219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d Aug 01 15:24:02 devstack sudo[113219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-bdb8786a-2970-4dba-a435-a712d508d8b0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-quobyte-bdb8786a-2970-4dba-a435-a712d508d8b0" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-bdb8786a-2970-4dba-a435-a712d508d8b0" acquired by "delete_volume" :: waited 0.056s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2bd39a-5cb2-4063-873c-81e6f9da0106]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:03 devstack sudo[113225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 Aug 01 15:24:03 devstack sudo[113225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:03 devstack sudo[113214]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f 1073741824" returned: 0 in 0.695s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=161,cinder:UPDATE=219,cinder:INSERT=63,cinder:DELETE=20 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:03 devstack sudo[113219]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e3dbb29d-797a-4e72-8a94-e365c7d5c60d" returned: 0 in 0.466s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:03 devstack sudo[113228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f Aug 01 15:24:03 devstack sudo[113228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-e3dbb29d-797a-4e72-8a94-e365c7d5c60d" released by "delete_volume" :: held 1.075s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Created reservations ['e9ee27a7-7f84-4da4-8c50-853123980343', 'b603e2c6-147c-49fd-bbc5-8315cc99436e', '53796f28-577c-46b2-80d4-4fa2c2187e75', '73377ec9-98f7-4a00-8c06-f99283a82364'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:03 devstack sudo[113231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:03 devstack sudo[113231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:03 devstack sudo[113225]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0" returned: 0 in 0.499s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:03 devstack sudo[113236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0 Aug 01 15:24:03 devstack sudo[113236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:03 devstack sudo[113228]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f" returned: 0 in 0.344s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-396859796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6feb037f-c6ac-492e-94a2-d8ad5e96aa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d0bac79f7864da0892ec9311b740a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:02Z,use_quota=True,user_id='a51048e7cf424a85b3c00daf981280df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Creating volume 6feb037f-c6ac-492e-94a2-d8ad5e96aa59 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:03 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:03 devstack sudo[113238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59 1073741824 Aug 01 15:24:03 devstack sudo[113238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2963ab6-f444-481f-8dce-0172bd0a562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1858cd30-e31e-4486-9603-0d852acbfd7f', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c63068a-d376-40a1-a9a3-f16a0994062a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume volume-1858cd30-e31e-4486-9603-0d852acbfd7f (1858cd30-e31e-4486-9603-0d852acbfd7f): created successfully Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c63068a-d376-40a1-a9a3-f16a0994062a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (f8037d91-244f-40a1-9420-7c5f918c25f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-452a63d3-4132-4a4f-b1c4-17ad59bf7b93 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created volume successfully. Aug 01 15:24:03 devstack sudo[113231]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.356s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Deleted volume successfully. Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-94ffe66f-2f21-4d7c-9e4d-6119bc772720 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-e3dbb29d-797a-4e72-8a94-e365c7d5c60d-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:03 devstack sudo[113236]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-bdb8786a-2970-4dba-a435-a712d508d8b0" returned: 0 in 0.318s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-bdb8786a-2970-4dba-a435-a712d508d8b0" released by "delete_volume" :: held 0.868s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:03 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Created reservations ['dbe23e51-049f-4970-9644-a1e4647ab827', '3b7800c0-1a3b-45e0-b6ec-502229c51cdc', 'bbd20970-edf4-4158-a8fa-43749a2ffc16', 'f04b52ca-a693-4707-8737-dc36d20c4f21'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:04 devstack sudo[113246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:04 devstack sudo[113246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:04 devstack sudo[113238]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59 1073741824" returned: 0 in 0.690s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:04 devstack sudo[113248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59 Aug 01 15:24:04 devstack sudo[113248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:04 devstack sudo[113246]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.486s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Deleted volume successfully. Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-51537391-64c8-48d2-8b7a-a6e19c28d23e tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-bdb8786a-2970-4dba-a435-a712d508d8b0-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:04 devstack sudo[113248]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59" returned: 0 in 0.453s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1508c2ac-d6c2-4b37-9583-2f9a92b5ba5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a29934-2574-4499-ab4a-9e4e2123bc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:04 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Volume volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59 (6feb037f-c6ac-492e-94a2-d8ad5e96aa59): created successfully Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a29934-2574-4499-ab4a-9e4e2123bc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Flow 'volume_create_manager' (e0adbac3-f8cc-4388-97fb-47fb870ecc6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a09e3b87-cac1-4e9e-af63-173e58e2851d tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created volume successfully. Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (38cb8117-a92f-402a-8c6c-794fe3460ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1815a48b-7d61-4eb0-9e10-2db31a6184ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1815a48b-7d61-4eb0-9e10-2db31a6184ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-939252975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed09935d-63a5-4320-b76a-8d49a4187a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:05Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3199fdbc-3c13-4e4e-8709-0b70c630d441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3199fdbc-3c13-4e4e-8709-0b70c630d441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c737ab99-e3c4-45bc-ac3a-4bf4f51a4774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c737ab99-e3c4-45bc-ac3a-4bf4f51a4774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed09935d-63a5-4320-b76a-8d49a4187a9e', 'volume_name': 'volume-ed09935d-63a5-4320-b76a-8d49a4187a9e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36f71d6-8a13-4016-a418-1a6d9919e6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36f71d6-8a13-4016-a418-1a6d9919e6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b227cf67-adbc-4d85-8c4b-6eb6ced27b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:05 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Volume ed09935d-63a5-4320-b76a-8d49a4187a9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed09935d-63a5-4320-b76a-8d49a4187a9e', 'volume_size': 1} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-939252975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed09935d-63a5-4320-b76a-8d49a4187a9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:05Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Creating volume ed09935d-63a5-4320-b76a-8d49a4187a9e {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:05 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:05 devstack sudo[113252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e 1073741824 Aug 01 15:24:05 devstack sudo[113252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-6feb037f-c6ac-492e-94a2-d8ad5e96aa59-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:05 devstack sudo[113252]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e 1073741824" returned: 0 in 0.508s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-6feb037f-c6ac-492e-94a2-d8ad5e96aa59-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-quobyte-6feb037f-c6ac-492e-94a2-d8ad5e96aa59" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-6feb037f-c6ac-492e-94a2-d8ad5e96aa59" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:05 devstack sudo[113258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e Aug 01 15:24:05 devstack sudo[113258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[02af277f-44e4-4750-9d40-9ae8cbbe1408]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:05 devstack sudo[113260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59 Aug 01 15:24:05 devstack sudo[113260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:06 devstack sudo[113258]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e" returned: 0 in 0.352s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b227cf67-adbc-4d85-8c4b-6eb6ced27b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed09935d-63a5-4320-b76a-8d49a4187a9e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677b9b87-28ee-4cf4-ac6a-70592df607fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:06 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Volume volume-ed09935d-63a5-4320-b76a-8d49a4187a9e (ed09935d-63a5-4320-b76a-8d49a4187a9e): created successfully Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677b9b87-28ee-4cf4-ac6a-70592df607fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (38cb8117-a92f-402a-8c6c-794fe3460ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:06 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cdf63646-72f6-4e4a-9a8a-740140a6dc2e tempest-VolumeDependencyTests-841441038 None] Created volume successfully. Aug 01 15:24:06 devstack sudo[113260]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59" returned: 0 in 0.447s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:06 devstack sudo[113266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59 Aug 01 15:24:06 devstack sudo[113266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:06 devstack sudo[113266]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-6feb037f-c6ac-492e-94a2-d8ad5e96aa59" returned: 0 in 0.276s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-6feb037f-c6ac-492e-94a2-d8ad5e96aa59" released by "delete_volume" :: held 0.780s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created reservations ['2e0c8052-302c-48e0-ba90-cb0a01f7b147', '84621061-53d2-4f79-9a63-b0f9b5216358', 'cb689227-1335-4c9f-a321-1b7cc93f6f08', '5aed2c52-fbcd-41db-adc5-5ee2d61f878a'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:06 devstack sudo[113269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:06 devstack sudo[113269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-1858cd30-e31e-4486-9603-0d852acbfd7f-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-1858cd30-e31e-4486-9603-0d852acbfd7f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-quobyte-1858cd30-e31e-4486-9603-0d852acbfd7f" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-1858cd30-e31e-4486-9603-0d852acbfd7f" acquired by "delete_volume" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[88029969-e476-4330-b783-ee45aaaf15d8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:07 devstack sudo[113269]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.455s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:07 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Deleted volume successfully. Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b48bcc1-66f5-4fe1-9d74-9660eb1414f4 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-6feb037f-c6ac-492e-94a2-d8ad5e96aa59-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:07 devstack sudo[113272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f Aug 01 15:24:07 devstack sudo[113272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] Creating offline snapshot 1ae21aab-00f4-4325-8dfa-761002a4904a of volume ed09935d-63a5-4320-b76a-8d49a4187a9e {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb0bbba-5639-4899-830a-96087b9ba42d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:07 devstack sudo[113281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e Aug 01 15:24:07 devstack sudo[113281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:07 devstack sudo[113272]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f" returned: 0 in 0.738s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:07 devstack sudo[113290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f Aug 01 15:24:07 devstack sudo[113290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:08 devstack sudo[113281]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e" returned: 0 in 0.728s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:08 devstack sudo[113301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a 1G Aug 01 15:24:08 devstack sudo[113301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:08 devstack sudo[113290]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1858cd30-e31e-4486-9603-0d852acbfd7f" returned: 0 in 0.548s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-1858cd30-e31e-4486-9603-0d852acbfd7f" released by "delete_volume" :: held 1.382s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Flow 'volume_create_manager' (911115d6-cf6c-4d0e-a1f1-7588d8a9ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5aa3f20-f8a0-4b3e-9bba-bfb3f40bbaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created reservations ['13f50f3b-7661-4e20-8000-9af502900279', '89373caa-fa53-44bd-b799-140061398cad', 'c63f78dd-3183-4c04-a0e5-e6693b8c8f61', '88caf0e1-bcc6-4b7b-beac-3b752ebe7a4e'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5aa3f20-f8a0-4b3e-9bba-bfb3f40bbaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26410efe-528b-489d-ab65-0605330f3331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af2e0ac207a45e6805ffa6c60bc79c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:09Z,use_quota=True,user_id='ab05d4fdd2684209bf3a1016b2141261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ed2011-94a1-46fa-915e-6840433fbd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ed2011-94a1-46fa-915e-6840433fbd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c352fb-46a6-4800-83fe-cecd4af005bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:08 devstack sudo[113319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:08 devstack sudo[113319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:08 devstack sudo[113301]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a 1G" returned: 0 in 0.666s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed09935d-63a5-4320-b76a-8d49a4187a9e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:09 devstack sudo[113321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed09935d-63a5-4320-b76a-8d49a4187a9e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a Aug 01 15:24:09 devstack sudo[113321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:09 devstack sudo[113319]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.312s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Deleted volume successfully. Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c352fb-46a6-4800-83fe-cecd4af005bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26410efe-528b-489d-ab65-0605330f3331', 'volume_name': 'volume-26410efe-528b-489d-ab65-0605330f3331', 'volume_size': 1, 'image_id': '225b07a7-75f3-45c1-8c39-b4491ebed081', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/225b07a7-75f3-45c1-8c39-b4491ebed081', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa445f4a515084fb9663673d04237d8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af2e0ac207a45e6805ffa6c60bc79c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de9a378ff63b724c2929fbdfa1cf4d4880633de03eb0de0ba95c95353915200eb162f469f9599bf6915e33f56cf3b91ca07aa9b9949bfed1872de0787451010f', 'id': '225b07a7-75f3-45c1-8c39-b4491ebed081', 'created_at': datetime.datetime(2026, 8, 1, 13, 24, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 24, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/225b07a7-75f3-45c1-8c39-b4491ebed081/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5f8daf-38a2-4d37-b451-0d3c8717093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5f8daf-38a2-4d37-b451-0d3c8717093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def33805-96f2-42f0-8885-a7267fc37294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:09 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Volume 26410efe-528b-489d-ab65-0605330f3331: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26410efe-528b-489d-ab65-0605330f3331', 'volume_size': 1, 'image_id': '225b07a7-75f3-45c1-8c39-b4491ebed081', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/225b07a7-75f3-45c1-8c39-b4491ebed081', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa445f4a515084fb9663673d04237d8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af2e0ac207a45e6805ffa6c60bc79c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de9a378ff63b724c2929fbdfa1cf4d4880633de03eb0de0ba95c95353915200eb162f469f9599bf6915e33f56cf3b91ca07aa9b9949bfed1872de0787451010f', 'id': '225b07a7-75f3-45c1-8c39-b4491ebed081', 'created_at': datetime.datetime(2026, 8, 1, 13, 24, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 24, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/225b07a7-75f3-45c1-8c39-b4491ebed081/file', 'properties': {}}, 'image_service': } Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Trying to clone 26410efe-528b-489d-ab65-0605330f3331 from image 225b07a7-75f3-45c1-8c39-b4491ebed081 at location (None, [{'url': 'file:///opt/stack/data/glance/images/225b07a7-75f3-45c1-8c39-b4491ebed081', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-62d5a2ef-5043-4bb8-af9e-93d3ae5cd4f9 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-1858cd30-e31e-4486-9603-0d852acbfd7f-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:24:09 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Image download 0.00 MB at 0.00 MB/s Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-fb8a95d2-67ca-4f23-bf07-05f092b26047-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-fb8a95d2-67ca-4f23-bf07-05f092b26047-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:09 devstack sudo[113321]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed09935d-63a5-4320-b76a-8d49a4187a9e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a" returned: 0 in 0.343s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:09 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a is being set with open permissions: ugo+rw Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68d1a3-f095-408d-90d0-d3bf9dfdf3f5]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:09 devstack sudo[113327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a Aug 01 15:24:09 devstack sudo[113327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-quobyte-fb8a95d2-67ca-4f23-bf07-05f092b26047" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-fb8a95d2-67ca-4f23-bf07-05f092b26047" acquired by "delete_volume" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[229c5373-58a3-4e7e-a3cc-d4f2838afcfc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:09 devstack sudo[113328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD Aug 01 15:24:09 devstack sudo[113328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:09 devstack sudo[113330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047 Aug 01 15:24:09 devstack sudo[113330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:09 devstack sudo[113327]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a" returned: 0 in 0.264s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:09 devstack sudo[113334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.info Aug 01 15:24:09 devstack sudo[113334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:09 devstack sudo[113328]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:09 devstack sudo[113330]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047" returned: 0 in 0.378s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:09 devstack sudo[113338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD Aug 01 15:24:09 devstack sudo[113338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:09 devstack sudo[113342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047 Aug 01 15:24:09 devstack sudo[113342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:09 devstack sudo[113334]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.info" returned: 0 in 0.276s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:09 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.info is being set with open permissions: ugo+rw Aug 01 15:24:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:09 devstack sudo[113346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.info Aug 01 15:24:09 devstack sudo[113346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:10 devstack sudo[113338]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Temporary image 225b07a7-75f3-45c1-8c39-b4491ebed081 is fetched for user ab05d4fdd2684209bf3a1016b2141261. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:24:10 devstack sudo[113342]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fb8a95d2-67ca-4f23-bf07-05f092b26047" returned: 0 in 0.266s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-fb8a95d2-67ca-4f23-bf07-05f092b26047" released by "delete_volume" :: held 0.689s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e509e95-d2fc-42b9-bc3d-10065ff99fab]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:10 devstack sudo[113346]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created reservations ['0a92de0f-3151-4bd7-874a-0591f5b771a8', 'f1657025-bd2d-4ec3-bb89-9afa08dc2d70', '0520ed19-0eee-47d2-b6e2-73639dbc8abb', 'e11e2df1-cc13-47d4-a7be-d9516bfae8b1'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.info" returned: 0 in 0.279s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.719s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-336f0f65-a97c-4d11-95b0-b50c060b6328 tempest-VolumeDependencyTests-841441038 None] Create snapshot completed successfully Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:10 devstack sudo[113354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD Aug 01 15:24:10 devstack sudo[113354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:10 devstack sudo[113356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:10 devstack sudo[113356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-8353fa8c-dc71-4fcf-b0da-28f7b02d804f-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-8353fa8c-dc71-4fcf-b0da-28f7b02d804f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:10 devstack sudo[113354]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:10 devstack sudo[113356]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.264s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-quobyte-8353fa8c-dc71-4fcf-b0da-28f7b02d804f" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Deleted volume successfully. Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-8353fa8c-dc71-4fcf-b0da-28f7b02d804f" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-aed4484d-860d-4611-8fb1-e1e21ba59eec tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-fb8a95d2-67ca-4f23-bf07-05f092b26047-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a70eb8-9c1e-4088-bf0e-1b6670d53980]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:10 devstack sudo[113361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD Aug 01 15:24:10 devstack sudo[113361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:10 devstack sudo[113362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f Aug 01 15:24:10 devstack sudo[113362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:10 devstack sudo[113361]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26410efe-528b-489d-ab65-0605330f3331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af2e0ac207a45e6805ffa6c60bc79c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:09Z,use_quota=True,user_id='ab05d4fdd2684209bf3a1016b2141261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Creating volume 26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:10 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:24:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:10 devstack sudo[113368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 1073741824 Aug 01 15:24:10 devstack sudo[113368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:11 devstack sudo[113362]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f" returned: 0 in 0.468s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:11 devstack sudo[113373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f Aug 01 15:24:11 devstack sudo[113373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (1c66a8eb-371c-46bd-9023-4f3942269efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e161cfd7-52fa-493a-a5b2-e6918f61b45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e161cfd7-52fa-493a-a5b2-e6918f61b45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-910974902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115aec6b-8e7b-4823-87cf-bdf39906dd26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1ae21aab-00f4-4325-8dfa-761002a4904a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:11Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3943c1-8036-4c7a-a439-e87689fec815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3943c1-8036-4c7a-a439-e87689fec815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb610722-c98f-4b0b-8194-e5110d27ff01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb610722-c98f-4b0b-8194-e5110d27ff01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '115aec6b-8e7b-4823-87cf-bdf39906dd26', 'volume_name': 'volume-115aec6b-8e7b-4823-87cf-bdf39906dd26', 'volume_size': 1, 'snapshot_id': '1ae21aab-00f4-4325-8dfa-761002a4904a'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38eb352-2c00-4bb5-9f5c-b32f10e9d47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38eb352-2c00-4bb5-9f5c-b32f10e9d47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e461385c-8c37-4453-bd69-66366d471dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:11 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Volume 115aec6b-8e7b-4823-87cf-bdf39906dd26: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-115aec6b-8e7b-4823-87cf-bdf39906dd26', 'volume_size': 1, 'snapshot_id': '1ae21aab-00f4-4325-8dfa-761002a4904a'} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:11 devstack sudo[113373]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8353fa8c-dc71-4fcf-b0da-28f7b02d804f" returned: 0 in 0.281s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-8353fa8c-dc71-4fcf-b0da-28f7b02d804f" released by "delete_volume" :: held 0.801s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:11 devstack sudo[113368]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 1073741824" returned: 0 in 0.482s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created reservations ['a5ffc648-5454-4bbe-90d6-404c5058fe1c', '83135443-3cb9-42a7-9cbb-adceb7b5a9db', 'ffe8e0fe-8187-469c-b075-b90754285214', 'd1b24434-0d48-4089-b800-c51d616b8528'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:11 devstack sudo[113380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 Aug 01 15:24:11 devstack sudo[113380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:11 devstack sudo[113383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:11 devstack sudo[113383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-quobyte-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:11 devstack sudo[113380]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa" acquired by "delete_volume" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331" returned: 0 in 0.317s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.440s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-1ae21aab-00f4-4325-8dfa-761002a4904a-115aec6b-8e7b-4823-87cf-bdf39906dd26" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[275bcb7c-4b26-4708-9ad4-f81bac2fc59d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-1ae21aab-00f4-4325-8dfa-761002a4904a-115aec6b-8e7b-4823-87cf-bdf39906dd26" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Creating volume 115aec6b-8e7b-4823-87cf-bdf39906dd26 from snapshot 1ae21aab-00f4-4325-8dfa-761002a4904a {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-115aec6b-8e7b-4823-87cf-bdf39906dd26" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Attempting download of 225b07a7-75f3-45c1-8c39-b4491ebed081 ((None, [{'url': 'file:///opt/stack/data/glance/images/225b07a7-75f3-45c1-8c39-b4491ebed081', 'metadata': {}}])) to volume 26410efe-528b-489d-ab65-0605330f3331. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-115aec6b-8e7b-4823-87cf-bdf39906dd26" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] snapshot: 1ae21aab-00f4-4325-8dfa-761002a4904a, volume: 115aec6b-8e7b-4823-87cf-bdf39906dd26, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:11 devstack sudo[113383]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.321s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:11 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Deleted volume successfully. Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cf3391-af31-45b2-8be4-27937e902fa7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea74ba23-9b3e-4468-834d-6effefcfb283]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_225b07a7-75f3-45c1-8c39-b4491ebed081_ldic95lx {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:11 devstack sudo[113386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa Aug 01 15:24:11 devstack sudo[113386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e73de5be-20b5-4dde-a0bc-ee382a54c02c tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-8353fa8c-dc71-4fcf-b0da-28f7b02d804f-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:12 devstack sudo[113388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a Aug 01 15:24:12 devstack sudo[113388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:12 devstack sudo[113390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_225b07a7-75f3-45c1-8c39-b4491ebed081_ldic95lx Aug 01 15:24:12 devstack sudo[113390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:12 devstack sudo[113386]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa" returned: 0 in 0.423s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:12 devstack sudo[113397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa Aug 01 15:24:12 devstack sudo[113397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:12 devstack sudo[113388]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a" returned: 0 in 0.383s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed09935d-63a5-4320-b76a-8d49a4187a9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[99189bf1-39ef-431d-8083-f837603af2f8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:12 devstack sudo[113390]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_225b07a7-75f3-45c1-8c39-b4491ebed081_ldic95lx" returned: 0 in 0.393s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_225b07a7-75f3-45c1-8c39-b4491ebed081_ldic95lx {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:12 devstack sudo[113403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e Aug 01 15:24:12 devstack sudo[113403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:12 devstack sudo[113404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_225b07a7-75f3-45c1-8c39-b4491ebed081_ldic95lx Aug 01 15:24:12 devstack sudo[113404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:12 devstack sudo[113397]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa" returned: 0 in 0.275s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa" released by "delete_volume" :: held 0.749s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created reservations ['b468580b-9cd6-4172-b06d-4e2c47e6a364', '6207e13f-9a3f-4e2c-a5b5-aee0f7794e3b', 'e4401707-2e14-4079-93ce-1d44aa3feb10', '9168b86a-e6f0-4c58-b910-383e5ae077cc'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:12 devstack sudo[113411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:12 devstack sudo[113411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:12 devstack sudo[113404]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_225b07a7-75f3-45c1-8c39-b4491ebed081_ldic95lx" returned: 1 in 0.395s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_225b07a7-75f3-45c1-8c39-b4491ebed081_ldic95lx' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[53688b6e-f415-4702-b41c-662c8374560b]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:12 devstack sudo[113403]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e" returned: 0 in 0.431s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:12 devstack sudo[113416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 Aug 01 15:24:12 devstack sudo[113416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:12 devstack sudo[113415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD Aug 01 15:24:12 devstack sudo[113415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "cinder-quobyte-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:12 devstack sudo[113411]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.354s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:13 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Deleted volume successfully. Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[444d87ac-5a32-495b-96f0-dda6e6bcd27d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e5816fce-35a0-47fa-b556-c12d06b0f68a tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-ccac86e9-9b4f-4f5b-b1ec-849784fbd7aa-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:13 devstack sudo[113415]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:13 devstack sudo[113420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9 Aug 01 15:24:13 devstack sudo[113420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:13 devstack sudo[113426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD Aug 01 15:24:13 devstack sudo[113426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:13 devstack sudo[113426]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD" returned: 1 in 0.488s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] 225b07a7-75f3-45c1-8c39-b4491ebed081 was raw, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:13 devstack sudo[113441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 Aug 01 15:24:13 devstack sudo[113441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:13 devstack sudo[113420]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9" returned: 0 in 0.787s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:13 devstack sudo[113445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9 Aug 01 15:24:13 devstack sudo[113445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:14 devstack sudo[113445]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9" returned: 0 in 0.620s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:14 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-quobyte-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9" released by "delete_volume" :: held 1.487s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:14 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Created reservations ['3f066f1a-39a3-4b2f-9018-fb9958014fc8', 'f6217c92-7d89-43da-9834-1c0d77f9c775', '7d2cd9b1-dcf8-4e64-9b9b-863c4efd7c8e', 'e94db11c-9ad6-4767-b415-a905c970d55b'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:14 devstack sudo[113451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:14 devstack sudo[113451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:15 devstack sudo[113441]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331" returned: 0 in 1.410s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:15 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_225b07a7-75f3-45c1-8c39-b4491ebed081_u6q6oergdevstack@QuobyteHD, size 0.00 MB, duration 1.41 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:24:15 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Converted 0.00 MB image at 0.00 MB/s Aug 01 15:24:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:15 devstack sudo[113453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 1G Aug 01 15:24:15 devstack sudo[113453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:15 devstack sudo[113451]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.587s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:15 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Deleted volume successfully. Aug 01 15:24:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ca8bd783-3046-4e36-aca1-61f4a1ef0a09 tempest-CreateVolumesFromSourceVolumeTest-1716339591 None] Lock "cinder-b35ece55-ff6c-4cdc-ad1b-01755f9f5ff9-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:16 devstack sudo[113453]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 1G" returned: 0 in 1.151s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:16 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Downloaded image 225b07a7-75f3-45c1-8c39-b4491ebed081 ((None, [{'url': 'file:///opt/stack/data/glance/images/225b07a7-75f3-45c1-8c39-b4491ebed081', 'metadata': {}}])) to volume 26410efe-528b-489d-ab65-0605330f3331 successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:24:16 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Temporary image 225b07a7-75f3-45c1-8c39-b4491ebed081 for user ab05d4fdd2684209bf3a1016b2141261 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:24:16 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Marking volume 26410efe-528b-489d-ab65-0605330f3331 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:24:16 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Copying metadata from image 225b07a7-75f3-45c1-8c39-b4491ebed081 to 26410efe-528b-489d-ab65-0605330f3331. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:24:16 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Creating volume glance metadata for volume 26410efe-528b-489d-ab65-0605330f3331 backed by image 225b07a7-75f3-45c1-8c39-b4491ebed081 with: {'image_id': '225b07a7-75f3-45c1-8c39-b4491ebed081', 'image_name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'checksum': 'aa445f4a515084fb9663673d04237d8b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:24:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def33805-96f2-42f0-8885-a7267fc37294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26410efe-528b-489d-ab65-0605330f3331', 'volume_size': 1, 'image_id': '225b07a7-75f3-45c1-8c39-b4491ebed081', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/225b07a7-75f3-45c1-8c39-b4491ebed081', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa445f4a515084fb9663673d04237d8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af2e0ac207a45e6805ffa6c60bc79c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'de9a378ff63b724c2929fbdfa1cf4d4880633de03eb0de0ba95c95353915200eb162f469f9599bf6915e33f56cf3b91ca07aa9b9949bfed1872de0787451010f', 'id': '225b07a7-75f3-45c1-8c39-b4491ebed081', 'created_at': datetime.datetime(2026, 8, 1, 13, 24, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 24, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/225b07a7-75f3-45c1-8c39-b4491ebed081/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80f23d8-2607-43ef-b012-a9950583409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:16 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Volume volume-26410efe-528b-489d-ab65-0605330f3331 (26410efe-528b-489d-ab65-0605330f3331): created successfully Aug 01 15:24:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80f23d8-2607-43ef-b012-a9950583409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Flow 'volume_create_manager' (911115d6-cf6c-4d0e-a1f1-7588d8a9ac40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:16 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-f8b30f1e-3a17-4991-9808-b7ab74d5a45f tempest-VolumeImageDependencyTests-696602523 None] Created volume successfully. Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:18 devstack sudo[113416]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26" returned: 0 in 5.867s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:24:18 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Converted 1024.00 MB image at 174.30 MB/s Aug 01 15:24:18 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 is being set with open permissions: ugo+rw Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:18 devstack sudo[113461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:18 devstack sudo[113461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:18 devstack sudo[113462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 Aug 01 15:24:18 devstack sudo[113462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:18 devstack sudo[113462]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26" returned: 0 in 0.351s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-115aec6b-8e7b-4823-87cf-bdf39906dd26" released by "_copy_volume_from_snapshot" :: held 7.150s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Flow 'volume_create_manager' (d65dd2c5-5ed2-4d62-93a2-bff36f7712ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6fc996-1e87-4465-94d4-7ff486034a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6fc996-1e87-4465-94d4-7ff486034a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82351e95-d5fd-4100-b15b-2c64e3fa29a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af2e0ac207a45e6805ffa6c60bc79c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=26410efe-528b-489d-ab65-0605330f3331,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:19Z,use_quota=True,user_id='ab05d4fdd2684209bf3a1016b2141261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a83033-8269-4462-bb97-6466ab294a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a83033-8269-4462-bb97-6466ab294a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee49214-eaf8-49f7-94b0-1df29f7e59a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee49214-eaf8-49f7-94b0-1df29f7e59a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '82351e95-d5fd-4100-b15b-2c64e3fa29a1', 'volume_name': 'volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1', 'volume_size': 1, 'source_volid': '26410efe-528b-489d-ab65-0605330f3331', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1c0541-8c23-4a1d-9949-18f88dc798f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1c0541-8c23-4a1d-9949-18f88dc798f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:19 devstack sudo[113461]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb96bdb-6905-47a4-8cac-7d0b3efc20dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:19 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Volume 82351e95-d5fd-4100-b15b-2c64e3fa29a1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1', 'volume_size': 1, 'source_volid': '26410efe-528b-489d-ab65-0605330f3331', 'source_volstatus': 'available'} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.559s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-1ae21aab-00f4-4325-8dfa-761002a4904a-115aec6b-8e7b-4823-87cf-bdf39906dd26" released by "_create_volume_from_snapshot" :: held 7.376s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.410s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.041s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:19 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Cloning volume 26410efe-528b-489d-ab65-0605330f3331 to volume 82351e95-d5fd-4100-b15b-2c64e3fa29a1 Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e461385c-8c37-4453-bd69-66366d471dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115aec6b-8e7b-4823-87cf-bdf39906dd26', 'volume_size': 1, 'snapshot_id': '1ae21aab-00f4-4325-8dfa-761002a4904a'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a18677-1386-47e2-b4b1-48f003262cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Creating offline snapshot 6f123b15-a3bd-4948-af68-221cf314834d of volume 26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:24:19 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Volume volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 (115aec6b-8e7b-4823-87cf-bdf39906dd26): created successfully Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a18677-1386-47e2-b4b1-48f003262cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (1c66a8eb-371c-46bd-9023-4f3942269efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4beb02-09d7-4688-8469-558a5373ddb4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c075e290-aa8d-466d-9338-273d393be6e5 tempest-VolumeDependencyTests-841441038 None] Created volume successfully. Aug 01 15:24:19 devstack sudo[113467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 Aug 01 15:24:19 devstack sudo[113467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:19 devstack sudo[113467]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331" returned: 0 in 0.383s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:19 devstack sudo[113472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d 1G Aug 01 15:24:19 devstack sudo[113472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:20 devstack sudo[113472]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d 1G" returned: 0 in 0.474s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26410efe-528b-489d-ab65-0605330f3331 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:20 devstack sudo[113479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26410efe-528b-489d-ab65-0605330f3331 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d Aug 01 15:24:20 devstack sudo[113479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:20 devstack sudo[113479]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26410efe-528b-489d-ab65-0605330f3331 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d" returned: 0 in 0.310s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:20 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d is being set with open permissions: ugo+rw Aug 01 15:24:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:20 devstack sudo[113485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d Aug 01 15:24:20 devstack sudo[113485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-093aa85c-5591-48d4-820f-644733e90375 tempest-ProjectAdminTests-735036017 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576751708984, 'free_capacity_gb': 1775.7576751708984, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89024) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 01 15:24:20 devstack sudo[113485]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d" returned: 0 in 0.264s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:20 devstack sudo[113524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.info Aug 01 15:24:20 devstack sudo[113524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:21 devstack sudo[113524]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.info" returned: 0 in 0.359s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:21 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.info is being set with open permissions: ugo+rw Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:21 devstack sudo[113529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.info Aug 01 15:24:21 devstack sudo[113529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:21 devstack sudo[113529]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.info" returned: 0 in 0.296s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-quobyte-82351e95-d5fd-4100-b15b-2c64e3fa29a1" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-82351e95-d5fd-4100-b15b-2c64e3fa29a1" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] snapshot: 6f123b15-a3bd-4948-af68-221cf314834d, volume: 82351e95-d5fd-4100-b15b-2c64e3fa29a1, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[66efc537-c5cf-4508-94a4-b2d2bade7ea2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:21 devstack sudo[113532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d Aug 01 15:24:21 devstack sudo[113532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Flow 'volume_create_manager' (5c6dd69a-33a2-4628-9134-2347e8d9e7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b58c6f-8080-44d4-8928-78fb379fe3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b58c6f-8080-44d4-8928-78fb379fe3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1555237434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5194739a-d327-4411-ad5f-23e1c7cfc79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a9664c1f624484b86a04352731e3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:22Z,use_quota=True,user_id='74ce19bc1ce44396b6596da7499917d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebee8a3-8e9d-4484-b3ee-38ac585ee9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebee8a3-8e9d-4484-b3ee-38ac585ee9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17f9fa5-0cef-4f12-aedd-729fb07a90ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17f9fa5-0cef-4f12-aedd-729fb07a90ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5194739a-d327-4411-ad5f-23e1c7cfc79e', 'volume_name': 'volume-5194739a-d327-4411-ad5f-23e1c7cfc79e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d8052c-11e5-463e-8664-43dc2fd5eb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d8052c-11e5-463e-8664-43dc2fd5eb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d04514a-6e79-4f20-aad9-9af1e0b20faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:22 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Volume 5194739a-d327-4411-ad5f-23e1c7cfc79e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5194739a-d327-4411-ad5f-23e1c7cfc79e', 'volume_size': 1} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:22 devstack sudo[113532]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d" returned: 0 in 0.485s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26410efe-528b-489d-ab65-0605330f3331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[589eedc8-7230-48eb-a549-597e29ccdcc7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:22 devstack sudo[113537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 Aug 01 15:24:22 devstack sudo[113537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:22 devstack sudo[113537]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331" returned: 0 in 0.401s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:24:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:22 devstack sudo[113543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 Aug 01 15:24:22 devstack sudo[113543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:23 devstack sudo[113543]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1" returned: 0 in 0.518s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:24:23 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 01 15:24:23 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 is being set with open permissions: ugo+rw Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:23 devstack sudo[113549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 Aug 01 15:24:23 devstack sudo[113549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:23 devstack sudo[113549]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1" returned: 0 in 0.267s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-82351e95-d5fd-4100-b15b-2c64e3fa29a1" released by "_copy_volume_from_snapshot" :: held 1.753s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-quobyte-6f123b15-a3bd-4948-af68-221cf314834d" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-6f123b15-a3bd-4948-af68-221cf314834d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Deleting offline snapshot 6f123b15-a3bd-4948-af68-221cf314834d of volume 26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] snapshot_file for this snap is: volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b61792-09f2-42dd-bbbf-c42bc17290ff]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:23 devstack sudo[113558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d Aug 01 15:24:23 devstack sudo[113558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:23 devstack sudo[113558]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d" returned: 0 in 0.376s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26410efe-528b-489d-ab65-0605330f3331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b9b0b4-d097-45e5-8eab-6f7667fbf094]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:23 devstack sudo[113563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 Aug 01 15:24:23 devstack sudo[113563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:24 devstack sudo[113563]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331" returned: 0 in 0.373s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:24 devstack sudo[113568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d Aug 01 15:24:24 devstack sudo[113568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:24 devstack sudo[113568]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:24 devstack sudo[113574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d Aug 01 15:24:24 devstack sudo[113574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:24 devstack sudo[113574]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331.6f123b15-a3bd-4948-af68-221cf314834d" returned: 0 in 0.254s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-6f123b15-a3bd-4948-af68-221cf314834d" released by "_delete_snapshot" :: held 1.454s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.620s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Marking volume 82351e95-d5fd-4100-b15b-2c64e3fa29a1 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.393s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (df86a562-6084-4c7f-b9d0-9ce840784340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acc833f-0383-4d1c-878c-06e58ddfb783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Copying metadata from source volume 26410efe-528b-489d-ab65-0605330f3331 to 82351e95-d5fd-4100-b15b-2c64e3fa29a1. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] Creating offline snapshot 660de518-aafd-4579-8985-9f4767f63afb of volume 115aec6b-8e7b-4823-87cf-bdf39906dd26 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acc833f-0383-4d1c-878c-06e58ddfb783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822709100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b79f424-aabe-464b-84d2-5c03bfe30f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:25Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca96b3b-7d39-4e24-820c-928e7e6f7a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca96b3b-7d39-4e24-820c-928e7e6f7a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b74236-c399-427a-8066-edd793e81b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b74236-c399-427a-8066-edd793e81b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b79f424-aabe-464b-84d2-5c03bfe30f8c', 'volume_name': 'volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380f6145-78da-41a2-98de-d181f3e13014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380f6145-78da-41a2-98de-d181f3e13014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fa8853-3a4b-431c-a082-4c587d65e0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:24 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Volume 7b79f424-aabe-464b-84d2-5c03bfe30f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c', 'volume_size': 1} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd54c59b-3013-482c-8228-73b10ed006b4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb96bdb-6905-47a4-8cac-7d0b3efc20dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1', 'volume_size': 1, 'source_volid': '26410efe-528b-489d-ab65-0605330f3331', 'source_volstatus': 'available'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273be72a-efaa-4b8c-92ec-dad248b96cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:25 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Volume volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 (82351e95-d5fd-4100-b15b-2c64e3fa29a1): created successfully Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273be72a-efaa-4b8c-92ec-dad248b96cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Flow 'volume_create_manager' (d65dd2c5-5ed2-4d62-93a2-bff36f7712ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:25 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-fd5ee577-37e9-4aab-917e-acc64b50c7c8 tempest-VolumeImageDependencyTests-696602523 None] Created volume successfully. Aug 01 15:24:25 devstack sudo[113577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 Aug 01 15:24:25 devstack sudo[113577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:25 devstack sudo[113577]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26" returned: 0 in 0.408s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:25 devstack sudo[113582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb 1G Aug 01 15:24:25 devstack sudo[113582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-26410efe-528b-489d-ab65-0605330f3331-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-26410efe-528b-489d-ab65-0605330f3331-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-quobyte-26410efe-528b-489d-ab65-0605330f3331" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-26410efe-528b-489d-ab65-0605330f3331" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06e49be-abe4-4f87-9b9f-9431960bd4a7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:25 devstack sudo[113584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 Aug 01 15:24:25 devstack sudo[113584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:25 devstack sudo[113582]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb 1G" returned: 0 in 0.445s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:25 devstack sudo[113590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb Aug 01 15:24:25 devstack sudo[113590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:25 devstack sudo[113584]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331" returned: 0 in 0.380s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:25 devstack sudo[113595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331 Aug 01 15:24:25 devstack sudo[113595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:26 devstack sudo[113590]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb" returned: 0 in 0.309s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:26 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb is being set with open permissions: ugo+rw Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:26 devstack sudo[113601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb Aug 01 15:24:26 devstack sudo[113601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:26 devstack sudo[113595]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-26410efe-528b-489d-ab65-0605330f3331" returned: 0 in 0.246s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-26410efe-528b-489d-ab65-0605330f3331" released by "delete_volume" :: held 0.686s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Created reservations ['807a5265-df9d-413f-87d6-5653b13260d2', '43c4f047-13b2-4b18-92df-5b14945e24d1', 'afa68616-9711-4d1c-bd56-38c8376ddc8f', '2410ed58-3878-4a7a-97f6-ba18784d9ffc'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:26 devstack sudo[113605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:26 devstack sudo[113605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:26 devstack sudo[113601]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb" returned: 0 in 0.250s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:26 devstack sudo[113608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.info Aug 01 15:24:26 devstack sudo[113608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:26 devstack sudo[113605]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.270s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Deleted volume successfully. Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-85b04b33-ac11-41b5-906e-a816ea76144f tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-26410efe-528b-489d-ab65-0605330f3331-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:26 devstack sudo[113608]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.info" returned: 0 in 0.279s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:26 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.info is being set with open permissions: ugo+rw Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:26 devstack sudo[113612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.info Aug 01 15:24:26 devstack sudo[113612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:26 devstack sudo[113612]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.info" returned: 0 in 0.245s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.883s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1555237434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5194739a-d327-4411-ad5f-23e1c7cfc79e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a9664c1f624484b86a04352731e3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:22Z,use_quota=True,user_id='74ce19bc1ce44396b6596da7499917d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Creating volume 5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:26 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:24:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:26 devstack sudo[113615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e 1073741824 Aug 01 15:24:26 devstack sudo[113615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-31311341-0f6e-45d6-a662-6e7c18218df2 tempest-VolumeDependencyTests-841441038 None] Create snapshot completed successfully Aug 01 15:24:27 devstack sudo[113615]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e 1073741824" returned: 0 in 0.440s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:27 devstack sudo[113621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e Aug 01 15:24:27 devstack sudo[113621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:27 devstack sudo[113621]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e" returned: 0 in 0.258s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.746s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822709100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b79f424-aabe-464b-84d2-5c03bfe30f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:25Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Creating volume 7b79f424-aabe-464b-84d2-5c03bfe30f8c {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:27 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:27 devstack sudo[113624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c 1073741824 Aug 01 15:24:27 devstack sudo[113624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d04514a-6e79-4f20-aad9-9af1e0b20faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5194739a-d327-4411-ad5f-23e1c7cfc79e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb6674e-3b06-44c8-b589-d8c45101ed81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:27 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Volume volume-5194739a-d327-4411-ad5f-23e1c7cfc79e (5194739a-d327-4411-ad5f-23e1c7cfc79e): created successfully Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb6674e-3b06-44c8-b589-d8c45101ed81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:27 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Flow 'volume_create_manager' (5c6dd69a-33a2-4628-9134-2347e8d9e7f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:27 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-bcfae767-1f22-4874-abe4-1ad399efab84 tempest-SnapshotDataIntegrityTests-992674527 None] Created volume successfully. Aug 01 15:24:28 devstack sudo[113624]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c 1073741824" returned: 0 in 0.579s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:28 devstack sudo[113629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c Aug 01 15:24:28 devstack sudo[113629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (00c3a107-4c8f-455e-a6e3-b17b565bfcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc952de-52da-4068-a83e-60fb51d07dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc952de-52da-4068-a83e-60fb51d07dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1425205834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b7790a-09e5-415a-97f4-852e5e1c58ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=660de518-aafd-4579-8985-9f4767f63afb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:28Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e9185f-b185-496d-b42e-8a28d078cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e9185f-b185-496d-b42e-8a28d078cba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f821afa-1933-47f9-9dbe-192e84d6c45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f821afa-1933-47f9-9dbe-192e84d6c45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13b7790a-09e5-415a-97f4-852e5e1c58ed', 'volume_name': 'volume-13b7790a-09e5-415a-97f4-852e5e1c58ed', 'volume_size': 1, 'snapshot_id': '660de518-aafd-4579-8985-9f4767f63afb'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927a325c-9a93-42ed-a8fa-48a315ff8605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927a325c-9a93-42ed-a8fa-48a315ff8605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a532381-75d4-4adc-9648-19d9a412c3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:28 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Volume 13b7790a-09e5-415a-97f4-852e5e1c58ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13b7790a-09e5-415a-97f4-852e5e1c58ed', 'volume_size': 1, 'snapshot_id': '660de518-aafd-4579-8985-9f4767f63afb'} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:28 devstack sudo[113629]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c" returned: 0 in 0.299s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.067s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-660de518-aafd-4579-8985-9f4767f63afb-13b7790a-09e5-415a-97f4-852e5e1c58ed" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fa8853-3a4b-431c-a082-4c587d65e0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833e3f3f-728b-40e2-8487-a783d5b85b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-660de518-aafd-4579-8985-9f4767f63afb-13b7790a-09e5-415a-97f4-852e5e1c58ed" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Creating volume 13b7790a-09e5-415a-97f4-852e5e1c58ed from snapshot 660de518-aafd-4579-8985-9f4767f63afb {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-13b7790a-09e5-415a-97f4-852e5e1c58ed" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:28 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Volume volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c (7b79f424-aabe-464b-84d2-5c03bfe30f8c): created successfully Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833e3f3f-728b-40e2-8487-a783d5b85b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (df86a562-6084-4c7f-b9d0-9ce840784340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-13b7790a-09e5-415a-97f4-852e5e1c58ed" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] snapshot: 660de518-aafd-4579-8985-9f4767f63afb, volume: 13b7790a-09e5-415a-97f4-852e5e1c58ed, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:24:28 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-10efcbc0-f16a-4921-87b4-b395ac8e87bb tempest-ProjectMemberTests-660978679 None] Created volume successfully. Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8f1a1a-f1f6-42bd-8b84-1a29ff32448d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:28 devstack sudo[113634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb Aug 01 15:24:28 devstack sudo[113634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:29 devstack sudo[113634]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb" returned: 0 in 0.469s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-115aec6b-8e7b-4823-87cf-bdf39906dd26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:24:29 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e430fe7d-ac45-4bcc-acf1-44193292d36b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:29 devstack sudo[113646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 Aug 01 15:24:29 devstack sudo[113646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:29 devstack sudo[113646]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26" returned: 0 in 0.489s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:24:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:24:29 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:24:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:29 devstack sudo[113651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed Aug 01 15:24:29 devstack sudo[113651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-8f11405e-b33a-4a9b-aa6b-60f5a9b4bf1e req-8d0998f4-c12a-4941-89e4-702ddc9f1b27 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Flow 'volume_create_manager' (f9575ce8-b667-404e-b7d0-03a73b6cae8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647e78d3-421d-4c18-ba01-80fde7ded165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647e78d3-421d-4c18-ba01-80fde7ded165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764ead27-6129-430f-97a1-4925035b736d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af2e0ac207a45e6805ffa6c60bc79c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:30Z,use_quota=True,user_id='ab05d4fdd2684209bf3a1016b2141261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086dad58-71e8-4f1b-9c87-f0461ba7d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086dad58-71e8-4f1b-9c87-f0461ba7d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96eb0a9-dfde-4b35-8f12-6427334f3a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.image.glance [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Creating Keystone auth plugin from conf {{(pid=89024) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 01 15:24:30 devstack sudo[113651]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed" returned: 0 in 0.504s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:24:30 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 01 15:24:30 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed is being set with open permissions: ugo+rw Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:30 devstack sudo[113666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed Aug 01 15:24:30 devstack sudo[113666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:30 devstack sudo[113666]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed" returned: 0 in 0.254s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96eb0a9-dfde-4b35-8f12-6427334f3a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '764ead27-6129-430f-97a1-4925035b736d', 'volume_name': 'volume-764ead27-6129-430f-97a1-4925035b736d', 'volume_size': 1, 'image_id': 'b220418f-828f-4fdf-8061-9ae5210b28e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b220418f-828f-4fdf-8061-9ae5210b28e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4d6d05c248f7280b6e00d7ef33a779f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af2e0ac207a45e6805ffa6c60bc79c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '752e0d4a4bd1d6021562ab1464357e35b8758e10bdc06985c02d8c5b1d60447cf7c355c1e382a4cf0e7eafacfbc8dbe302727b0038d1823c9ca377deac860a58', 'id': 'b220418f-828f-4fdf-8061-9ae5210b28e0', 'created_at': datetime.datetime(2026, 8, 1, 13, 24, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 24, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b220418f-828f-4fdf-8061-9ae5210b28e0/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc07a072-b488-49fd-83ee-47015298512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc07a072-b488-49fd-83ee-47015298512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918cf200-a0b1-4c7d-82ed-35736fb7c9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:30 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Volume 764ead27-6129-430f-97a1-4925035b736d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-764ead27-6129-430f-97a1-4925035b736d', 'volume_size': 1, 'image_id': 'b220418f-828f-4fdf-8061-9ae5210b28e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b220418f-828f-4fdf-8061-9ae5210b28e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4d6d05c248f7280b6e00d7ef33a779f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af2e0ac207a45e6805ffa6c60bc79c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '752e0d4a4bd1d6021562ab1464357e35b8758e10bdc06985c02d8c5b1d60447cf7c355c1e382a4cf0e7eafacfbc8dbe302727b0038d1823c9ca377deac860a58', 'id': 'b220418f-828f-4fdf-8061-9ae5210b28e0', 'created_at': datetime.datetime(2026, 8, 1, 13, 24, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 24, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b220418f-828f-4fdf-8061-9ae5210b28e0/file', 'properties': {}}, 'image_service': } Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Trying to clone 764ead27-6129-430f-97a1-4925035b736d from image b220418f-828f-4fdf-8061-9ae5210b28e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b220418f-828f-4fdf-8061-9ae5210b28e0', 'metadata': {}}]). {{(pid=89024) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-13b7790a-09e5-415a-97f4-852e5e1c58ed" released by "_copy_volume_from_snapshot" :: held 1.854s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-660de518-aafd-4579-8985-9f4767f63afb-13b7790a-09e5-415a-97f4-852e5e1c58ed" released by "_create_volume_from_snapshot" :: held 1.956s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.992s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.102s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] Creating offline snapshot d05f7ea2-2e49-4776-aafc-80af8ffeb38a of volume 7b79f424-aabe-464b-84d2-5c03bfe30f8c {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:743}} Aug 01 15:24:30 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Image download 0.00 MB at 0.00 MB/s Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a532381-75d4-4adc-9648-19d9a412c3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b7790a-09e5-415a-97f4-852e5e1c58ed', 'volume_size': 1, 'snapshot_id': '660de518-aafd-4579-8985-9f4767f63afb'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2f6fbf-df4e-4075-a9a2-0b0432843a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61bdbaf-ed3c-48bc-b714-bf10443b84a8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:30 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Volume volume-13b7790a-09e5-415a-97f4-852e5e1c58ed (13b7790a-09e5-415a-97f4-852e5e1c58ed): created successfully Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2f6fbf-df4e-4075-a9a2-0b0432843a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (00c3a107-4c8f-455e-a6e3-b17b565bfcbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe30ef3-68d9-4c4d-b73d-53265cd3a883]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:30 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6dda0b1c-d8e3-4e88-8a31-d4afb2fff66f tempest-VolumeDependencyTests-841441038 None] Created volume successfully. Aug 01 15:24:30 devstack sudo[113669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c Aug 01 15:24:30 devstack sudo[113669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:30 devstack sudo[113670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD Aug 01 15:24:30 devstack sudo[113670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:31 devstack sudo[113669]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c" returned: 0 in 0.393s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:31 devstack sudo[113670]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:31 devstack sudo[113678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a 1G Aug 01 15:24:31 devstack sudo[113678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:31 devstack sudo[113679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD Aug 01 15:24:31 devstack sudo[113679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:31 devstack sudo[113679]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Temporary image b220418f-828f-4fdf-8061-9ae5210b28e0 is fetched for user ab05d4fdd2684209bf3a1016b2141261. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1442}} Aug 01 15:24:31 devstack sudo[113678]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-1ae21aab-00f4-4325-8dfa-761002a4904a-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a 1G" returned: 0 in 0.431s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-1ae21aab-00f4-4325-8dfa-761002a4904a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-ed09935d-63a5-4320-b76a-8d49a4187a9e" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:31 devstack sudo[113688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a Aug 01 15:24:31 devstack sudo[113688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-ed09935d-63a5-4320-b76a-8d49a4187a9e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-1ae21aab-00f4-4325-8dfa-761002a4904a" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[753bc67e-d272-4123-b8e5-4db57dcde118]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-1ae21aab-00f4-4325-8dfa-761002a4904a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Deleting offline snapshot 1ae21aab-00f4-4325-8dfa-761002a4904a of volume ed09935d-63a5-4320-b76a-8d49a4187a9e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] snapshot_file for this snap is: volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[834747c8-44c3-4f7c-93d5-3ac379f26a72]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:31 devstack sudo[113690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD Aug 01 15:24:31 devstack sudo[113690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:31 devstack sudo[113691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a Aug 01 15:24:31 devstack sudo[113691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:31 devstack sudo[113688]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a" returned: 0 in 0.367s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:31 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a is being set with open permissions: ugo+rw Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:31 devstack sudo[113697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a Aug 01 15:24:31 devstack sudo[113697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:31 devstack sudo[113690]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:32 devstack sudo[113691]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a" returned: 0 in 0.395s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed09935d-63a5-4320-b76a-8d49a4187a9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:24:32 devstack sudo[113701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD Aug 01 15:24:32 devstack sudo[113701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[273112e2-afad-4ebb-be2a-ed3691a0e28e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:32 devstack sudo[113697]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a" returned: 0 in 0.277s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:32 devstack sudo[113706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e Aug 01 15:24:32 devstack sudo[113706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:32 devstack sudo[113708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.info Aug 01 15:24:32 devstack sudo[113708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:32 devstack sudo[113701]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:32 devstack sudo[113708]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.info" returned: 0 in 0.259s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:32 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.info is being set with open permissions: ugo+rw Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:32 devstack sudo[113717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.info Aug 01 15:24:32 devstack sudo[113717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:32 devstack sudo[113706]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e" returned: 0 in 0.560s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:32 devstack sudo[113720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a Aug 01 15:24:32 devstack sudo[113720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:32 devstack sudo[113717]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.info" returned: 0 in 0.256s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-8f11405e-b33a-4a9b-aa6b-60f5a9b4bf1e req-8d0998f4-c12a-4941-89e4-702ddc9f1b27 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.663s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-8f11405e-b33a-4a9b-aa6b-60f5a9b4bf1e req-8d0998f4-c12a-4941-89e4-702ddc9f1b27 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764ead27-6129-430f-97a1-4925035b736d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af2e0ac207a45e6805ffa6c60bc79c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:30Z,use_quota=True,user_id='ab05d4fdd2684209bf3a1016b2141261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Creating volume 764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:32 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:32 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c19ecdc2-2b4d-4091-b59a-2fc8feffff9b tempest-ProjectMemberTests-660978679 None] Create snapshot completed successfully Aug 01 15:24:32 devstack sudo[113723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d 1073741824 Aug 01 15:24:32 devstack sudo[113723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-8f11405e-b33a-4a9b-aa6b-60f5a9b4bf1e req-8d0998f4-c12a-4941-89e4-702ddc9f1b27 tempest-SnapshotDataIntegrityTests-992674527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-5194739a-d327-4411-ad5f-23e1c7cfc79e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebd4e122-22b5-4956-b775-4eaab3236b6c', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:24:32 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-8f11405e-b33a-4a9b-aa6b-60f5a9b4bf1e req-8d0998f4-c12a-4941-89e4-702ddc9f1b27 tempest-SnapshotDataIntegrityTests-992674527 None] attachment_update completed successfully. Aug 01 15:24:33 devstack sudo[113720]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a" returned: 0 in 0.430s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:33 devstack sudo[113795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a Aug 01 15:24:33 devstack sudo[113795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:33 devstack sudo[113723]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d 1073741824" returned: 0 in 0.533s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:33 devstack sudo[113795]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e.1ae21aab-00f4-4325-8dfa-761002a4904a" returned: 0 in 0.278s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:33 devstack sudo[114120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d Aug 01 15:24:33 devstack sudo[114120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-1ae21aab-00f4-4325-8dfa-761002a4904a" released by "_delete_snapshot" :: held 1.797s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-ed09935d-63a5-4320-b76a-8d49a4187a9e" released by "delete_snapshot" :: held 1.834s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Created reservations ['e5347d77-e056-4c8e-9232-91b9d3eca4cf', '50da1a17-9610-4d49-a47d-bc905e3ad3da', '11d7b666-5064-4078-84ad-f56fc14ab1d6', '48878c61-2420-4008-a68b-6192e3864da0'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:33 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Delete snapshot completed successfully. Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-022b99a5-7ea6-40e9-9ee9-3f99d465ddc1 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-1ae21aab-00f4-4325-8dfa-761002a4904a-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:33 devstack sudo[114120]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d" returned: 0 in 0.282s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Attempting download of b220418f-828f-4fdf-8061-9ae5210b28e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/b220418f-828f-4fdf-8061-9ae5210b28e0', 'metadata': {}}])) to volume 764ead27-6129-430f-97a1-4925035b736d. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-660de518-aafd-4579-8985-9f4767f63afb-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-660de518-aafd-4579-8985-9f4767f63afb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-115aec6b-8e7b-4823-87cf-bdf39906dd26" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26e3cb3-3ee1-4775-80d8-2ae7855d2b71]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b220418f-828f-4fdf-8061-9ae5210b28e0_pr__9z3z {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-115aec6b-8e7b-4823-87cf-bdf39906dd26" acquired by "delete_snapshot" :: waited 0.043s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-660de518-aafd-4579-8985-9f4767f63afb" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-660de518-aafd-4579-8985-9f4767f63afb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Deleting offline snapshot 660de518-aafd-4579-8985-9f4767f63afb of volume 115aec6b-8e7b-4823-87cf-bdf39906dd26 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] snapshot_file for this snap is: volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-d05f7ea2-2e49-4776-aafc-80af8ffeb38a-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf8f79b-f6d4-4aba-a3ff-ca3590c1ee2a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Lock "cinder-d05f7ea2-2e49-4776-aafc-80af8ffeb38a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-7b79f424-aabe-464b-84d2-5c03bfe30f8c" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-7b79f424-aabe-464b-84d2-5c03bfe30f8c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-d05f7ea2-2e49-4776-aafc-80af8ffeb38a" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-d05f7ea2-2e49-4776-aafc-80af8ffeb38a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Deleting offline snapshot d05f7ea2-2e49-4776-aafc-80af8ffeb38a of volume 7b79f424-aabe-464b-84d2-5c03bfe30f8c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:24:33 devstack sudo[114124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b220418f-828f-4fdf-8061-9ae5210b28e0_pr__9z3z Aug 01 15:24:33 devstack sudo[114124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] snapshot_file for this snap is: volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a8bfbb-2caa-443b-99df-4990ba1c5d5e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:34 devstack sudo[114125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb Aug 01 15:24:34 devstack sudo[114125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:34 devstack sudo[114127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a Aug 01 15:24:34 devstack sudo[114127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:34 devstack sudo[114124]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b220418f-828f-4fdf-8061-9ae5210b28e0_pr__9z3z" returned: 0 in 0.458s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b220418f-828f-4fdf-8061-9ae5210b28e0_pr__9z3z {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:34 devstack sudo[114136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b220418f-828f-4fdf-8061-9ae5210b28e0_pr__9z3z Aug 01 15:24:34 devstack sudo[114136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:34 devstack sudo[114125]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb" returned: 0 in 0.538s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-115aec6b-8e7b-4823-87cf-bdf39906dd26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[344a1111-90f4-4189-8a36-07761ef27b3f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:34 devstack sudo[114127]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a" returned: 0 in 0.471s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0fda3-d754-4987-b5fd-f01080eb5dab]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:34 devstack sudo[114150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 Aug 01 15:24:34 devstack sudo[114150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:34 devstack sudo[114136]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b220418f-828f-4fdf-8061-9ae5210b28e0_pr__9z3z" returned: 1 in 0.419s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b220418f-828f-4fdf-8061-9ae5210b28e0_pr__9z3z' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1f3554-134e-4c89-a070-4707304460c5]: (4, 'raw') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:34 devstack sudo[114151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c Aug 01 15:24:34 devstack sudo[114151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:34 devstack sudo[114164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD Aug 01 15:24:34 devstack sudo[114164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:34 devstack sudo[114150]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26" returned: 0 in 0.433s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:34 devstack sudo[114175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb Aug 01 15:24:34 devstack sudo[114175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:34 devstack sudo[114151]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c" returned: 0 in 0.464s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:35 devstack sudo[114180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a Aug 01 15:24:35 devstack sudo[114180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:35 devstack sudo[114164]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:35 devstack sudo[114186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD Aug 01 15:24:35 devstack sudo[114186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:35 devstack sudo[114175]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb" returned: 0 in 0.414s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:35 devstack sudo[114197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb Aug 01 15:24:35 devstack sudo[114197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:35 devstack sudo[114186]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD' failed. Not Retrying. {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] b220418f-828f-4fdf-8061-9ae5210b28e0 was raw, converting to qcow2 {{(pid=89024) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1131}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:35 devstack sudo[114202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d Aug 01 15:24:35 devstack sudo[114180]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:35 devstack sudo[114202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a" returned: 0 in 0.500s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:35 devstack sudo[114204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a Aug 01 15:24:35 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:35 devstack sudo[114197]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26.660de518-aafd-4579-8985-9f4767f63afb" returned: 0 in 0.380s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-660de518-aafd-4579-8985-9f4767f63afb" released by "_delete_snapshot" :: held 1.932s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-115aec6b-8e7b-4823-87cf-bdf39906dd26" released by "delete_snapshot" :: held 1.960s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Creating online snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 of volume 5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dc7bd5-c694-46e4-9182-b473547a53b0]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:35 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c.d05f7ea2-2e49-4776-aafc-80af8ffeb38a" returned: 0 in 0.344s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-d05f7ea2-2e49-4776-aafc-80af8ffeb38a" released by "_delete_snapshot" :: held 1.937s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Created reservations ['e2317e8a-9ad8-4135-9ff4-757a8138dade', 'b3e46802-e8b5-47a4-ac81-bf224414d154', 'c28d4828-6397-4f5f-a433-6566fe09aa29', '7e769a66-3715-4f10-8827-c6116fee07fa'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-7b79f424-aabe-464b-84d2-5c03bfe30f8c" released by "delete_snapshot" :: held 1.967s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:35 devstack sudo[114211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e Aug 01 15:24:35 devstack sudo[114211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:35 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Delete snapshot completed successfully. Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c0ebfe0c-5ac7-43df-94c6-66ebbc32f888 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-660de518-aafd-4579-8985-9f4767f63afb-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:35 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Created reservations ['669f57c5-5943-435a-a928-a36d12f5b30d', '3cefdb81-2eb4-417c-a354-f26afeebc0de', '5009bf51-5462-42a7-9caa-2c0f7df2f5d1', '485b02ee-a524-43f6-99fd-65e32ebf06d0'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:36 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Delete snapshot completed successfully. Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-237e078c-7c39-44c2-b702-e2c3bf646aef tempest-ProjectMemberTests-660978679 None] Lock "cinder-d05f7ea2-2e49-4776-aafc-80af8ffeb38a-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:36 devstack sudo[114202]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d" returned: 0 in 0.636s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b220418f-828f-4fdf-8061-9ae5210b28e0_qvh_xw5adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:24:36 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Converted 0.00 MB image at 0.00 MB/s Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:36 devstack sudo[114214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d 1G Aug 01 15:24:36 devstack sudo[114214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:36 devstack sudo[114211]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e" returned: 0 in 0.395s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:36 devstack sudo[114219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 1G Aug 01 15:24:36 devstack sudo[114219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:36 devstack sudo[114214]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d 1G" returned: 0 in 0.321s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Downloaded image b220418f-828f-4fdf-8061-9ae5210b28e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/b220418f-828f-4fdf-8061-9ae5210b28e0', 'metadata': {}}])) to volume 764ead27-6129-430f-97a1-4925035b736d successfully. {{(pid=89024) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Temporary image b220418f-828f-4fdf-8061-9ae5210b28e0 for user ab05d4fdd2684209bf3a1016b2141261 is deleted. {{(pid=89024) fetch /opt/stack/cinder/cinder/image/image_utils.py:1446}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Marking volume 764ead27-6129-430f-97a1-4925035b736d as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Copying metadata from image b220418f-828f-4fdf-8061-9ae5210b28e0 to 764ead27-6129-430f-97a1-4925035b736d. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Creating volume glance metadata for volume 764ead27-6129-430f-97a1-4925035b736d backed by image b220418f-828f-4fdf-8061-9ae5210b28e0 with: {'image_id': 'b220418f-828f-4fdf-8061-9ae5210b28e0', 'image_name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'checksum': 'e4d6d05c248f7280b6e00d7ef33a779f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89024) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918cf200-a0b1-4c7d-82ed-35736fb7c9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-764ead27-6129-430f-97a1-4925035b736d', 'volume_size': 1, 'image_id': 'b220418f-828f-4fdf-8061-9ae5210b28e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b220418f-828f-4fdf-8061-9ae5210b28e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4d6d05c248f7280b6e00d7ef33a779f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af2e0ac207a45e6805ffa6c60bc79c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '752e0d4a4bd1d6021562ab1464357e35b8758e10bdc06985c02d8c5b1d60447cf7c355c1e382a4cf0e7eafacfbc8dbe302727b0038d1823c9ca377deac860a58', 'id': 'b220418f-828f-4fdf-8061-9ae5210b28e0', 'created_at': datetime.datetime(2026, 8, 1, 13, 24, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 1, 13, 24, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b220418f-828f-4fdf-8061-9ae5210b28e0/file', 'properties': {}}, 'image_service': }' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f051db-ab96-4d48-8988-d86daeff0546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:36 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Volume volume-764ead27-6129-430f-97a1-4925035b736d (764ead27-6129-430f-97a1-4925035b736d): created successfully Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f051db-ab96-4d48-8988-d86daeff0546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Flow 'volume_create_manager' (f9575ce8-b667-404e-b7d0-03a73b6cae8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:36 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5f59b03a-a750-4466-a2da-7b9609fb23da tempest-VolumeImageDependencyTests-696602523 None] Created volume successfully. Aug 01 15:24:36 devstack sudo[114219]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 1G" returned: 0 in 0.446s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5194739a-d327-4411-ad5f-23e1c7cfc79e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:36 devstack sudo[114227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5194739a-d327-4411-ad5f-23e1c7cfc79e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 Aug 01 15:24:36 devstack sudo[114227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-ed09935d-63a5-4320-b76a-8d49a4187a9e-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:36 devstack sudo[114227]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5194739a-d327-4411-ad5f-23e1c7cfc79e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50" returned: 0 in 0.310s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:36 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 is being set with open permissions: ugo+rw Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-ed09935d-63a5-4320-b76a-8d49a4187a9e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:36 devstack sudo[114232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 Aug 01 15:24:36 devstack sudo[114232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-ed09935d-63a5-4320-b76a-8d49a4187a9e" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-ed09935d-63a5-4320-b76a-8d49a4187a9e" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7f2ff3-90f7-4a1d-bc6e-0d68034c10f5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-7b79f424-aabe-464b-84d2-5c03bfe30f8c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Lock "cinder-7b79f424-aabe-464b-84d2-5c03bfe30f8c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-7b79f424-aabe-464b-84d2-5c03bfe30f8c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-7b79f424-aabe-464b-84d2-5c03bfe30f8c" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:37 devstack sudo[114234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e Aug 01 15:24:37 devstack sudo[114234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:37 devstack sudo[114232]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a20aa3-e4d2-4b0a-82b3-bae98be396dc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50" returned: 0 in 0.319s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:24:37 devstack sudo[114237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c Aug 01 15:24:37 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] REQ: curl -g -i -X POST http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}aa4e3a5afe6da52f83f6660488ac773730656f4225dcd47a5d7bead51e9425f5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-196fd6ec-443d-4941-bd16-1451fe26bbcc" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" -d '{"snapshot": {"volume_id": "5194739a-d327-4411-ad5f-23e1c7cfc79e", "create_info": {"type": "qcow2", "new_file": "volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50", "snapshot_id": "1c00346e-7d5d-4b93-92ce-c40efc28fb50"}}}' {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:24:37 devstack sudo[114234]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e" returned: 0 in 0.418s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:37 devstack sudo[114242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e Aug 01 15:24:37 devstack sudo[114242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Sat, 01 Aug 2026 13:24:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4a06c08e-442a-4a06-89a1-e39acd623db0 x-openstack-request-id: req-4a06c08e-442a-4a06-89a1-e39acd623db0 {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "5194739a-d327-4411-ad5f-23e1c7cfc79e"}} {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] POST call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots used request id req-4a06c08e-442a-4a06-89a1-e39acd623db0 {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] nova call result: None {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:37 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c" returned: 0 in 0.487s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:37 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c Aug 01 15:24:37 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:37 devstack sudo[114242]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed09935d-63a5-4320-b76a-8d49a4187a9e" returned: 0 in 0.322s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-ed09935d-63a5-4320-b76a-8d49a4187a9e" released by "delete_volume" :: held 0.820s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:37 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Created reservations ['ba65e42e-b797-4760-ac63-6a6f5c1cf644', 'a659e2ef-ca89-4da7-bc2a-c698d1e8228a', '3c7e8a86-3b35-4636-91b3-c46f17320a46', 'a6646e08-178a-4d8a-bb21-83f9e0a7b6d5'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:38 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:38 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:38 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7b79f424-aabe-464b-84d2-5c03bfe30f8c" returned: 0 in 0.373s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-115aec6b-8e7b-4823-87cf-bdf39906dd26-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-7b79f424-aabe-464b-84d2-5c03bfe30f8c" released by "delete_volume" :: held 0.929s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-115aec6b-8e7b-4823-87cf-bdf39906dd26-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Created reservations ['64623a25-1329-4c34-8b00-d9f6a3614b87', '3909b539-efcc-4c17-8aa7-5e41bbf10239', '9089eb30-3046-483e-a540-4d711295df3f', 'cae8f74d-bb0f-4c99-8efd-c7d916f428be'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-115aec6b-8e7b-4823-87cf-bdf39906dd26" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-115aec6b-8e7b-4823-87cf-bdf39906dd26" acquired by "delete_volume" :: waited 0.030s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb67cd7-bcf9-4bd7-be98-908d7b3ee8eb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:38 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.308s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:38 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Deleted volume successfully. Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a3cec9db-d016-4e09-b6e5-6e3986c54e83 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-ed09935d-63a5-4320-b76a-8d49a4187a9e-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:38 devstack sudo[114260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:38 devstack sudo[114260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:38 devstack sudo[114259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 Aug 01 15:24:38 devstack sudo[114259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:38 devstack sudo[114260]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.275s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:38 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Deleted volume successfully. Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ad24e489-9a16-4bac-aa9d-57f8c4eebbae tempest-ProjectMemberTests-660978679 None] Lock "cinder-7b79f424-aabe-464b-84d2-5c03bfe30f8c-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:38 devstack sudo[114259]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26" returned: 0 in 0.402s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:38 devstack sudo[114267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26 Aug 01 15:24:38 devstack sudo[114267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:38 devstack sudo[114267]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-115aec6b-8e7b-4823-87cf-bdf39906dd26" returned: 0 in 0.262s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-115aec6b-8e7b-4823-87cf-bdf39906dd26" released by "delete_volume" :: held 0.729s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Created reservations ['5259f034-aec6-495b-9d2f-6b237528d7ee', '3da18597-97f1-4233-aab6-a5bf73890fbe', '8d43bedd-dc9c-4c86-bf01-c70686d87619', 'db39bf95-97f2-41ae-babe-a79066f6e363'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:39 devstack sudo[114270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:39 devstack sudo[114270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-13b7790a-09e5-415a-97f4-852e5e1c58ed-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Lock "cinder-13b7790a-09e5-415a-97f4-852e5e1c58ed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:39 devstack sudo[114270]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.274s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:39 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Deleted volume successfully. Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-13b7790a-09e5-415a-97f4-852e5e1c58ed" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-19480076-847b-4649-ac74-2e31af0b5ea2 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-115aec6b-8e7b-4823-87cf-bdf39906dd26-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-13b7790a-09e5-415a-97f4-852e5e1c58ed" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cdc93e-276d-4fd5-a18a-3c7057686926]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:39 devstack sudo[114273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed Aug 01 15:24:39 devstack sudo[114273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (11076255-7c1b-4574-854b-ee4e7420cace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3cc72f-ca61-48ba-a454-af2e2614b041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:39 devstack sudo[114273]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed" returned: 0 in 0.433s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3cc72f-ca61-48ba-a454-af2e2614b041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840164427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0a9fc9-06df-4284-b1bb-2053a34f7402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:40Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa5d567-9cdb-4040-8286-12ae73c5e3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa5d567-9cdb-4040-8286-12ae73c5e3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575f2b82-baa4-4b87-8d52-db5b9c65c673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575f2b82-baa4-4b87-8d52-db5b9c65c673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0a9fc9-06df-4284-b1bb-2053a34f7402', 'volume_name': 'volume-be0a9fc9-06df-4284-b1bb-2053a34f7402', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8cf1f7-6f9f-4a14-a900-43c5565e3423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8cf1f7-6f9f-4a14-a900-43c5565e3423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938c76ac-a32b-48f5-9800-4ca137776480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:39 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Volume be0a9fc9-06df-4284-b1bb-2053a34f7402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0a9fc9-06df-4284-b1bb-2053a34f7402', 'volume_size': 1} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:39 devstack sudo[114278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed Aug 01 15:24:39 devstack sudo[114278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:40 devstack sudo[114278]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-13b7790a-09e5-415a-97f4-852e5e1c58ed" returned: 0 in 0.258s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-13b7790a-09e5-415a-97f4-852e5e1c58ed" released by "delete_volume" :: held 0.775s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Created reservations ['4d7456e6-4c87-4719-8a11-e475254daa78', 'b360889d-d3c1-45cc-b0d0-cafaed663a93', '120e4c77-72a2-4814-9fe0-43b1c3e7917b', '3b0caad8-9df3-4219-9ac8-b0b5da498311'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:40 devstack sudo[114282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:24:40 devstack sudo[114282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:40 devstack sudo[114282]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.244s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:24:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Deleted volume successfully. Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7596bd40-507d-46f1-b8d4-845c3552b2ba tempest-VolumeDependencyTests-841441038 None] Lock "cinder-13b7790a-09e5-415a-97f4-852e5e1c58ed-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:40 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (26992c3c-8b84-43b5-90f2-7a6f63a15129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d34585bc-7a8a-4dc1-9e69-dc943a7cd8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d34585bc-7a8a-4dc1-9e69-dc943a7cd8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-266027266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:41Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cbb531-ed0f-45f7-b01c-ae04ff803550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cbb531-ed0f-45f7-b01c-ae04ff803550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6325c395-e0f4-4a82-8d44-cb328df85ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6325c395-e0f4-4a82-8d44-cb328df85ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1', 'volume_name': 'volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cf2b73-d180-48ae-8e11-72d255fd5d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cf2b73-d180-48ae-8e11-72d255fd5d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0110fbf-2551-4408-8bdc-c2d10b0907a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:41 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Volume ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1', 'volume_size': 1} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:54 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:24:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:54 devstack sudo[114313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.info Aug 01 15:24:54 devstack sudo[114313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:55 devstack sudo[114313]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.info" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:55 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.info is being set with open permissions: ugo+rw Aug 01 15:24:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:55 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.info Aug 01 15:24:55 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:55 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.info" returned: 0 in 0.245s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.578s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.252s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] Creating offline snapshot 03d07264-99f9-423b-8dbc-e1bf4f6d595e of volume 764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:24:55 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-196fd6ec-443d-4941-bd16-1451fe26bbcc tempest-SnapshotDataIntegrityTests-992674527 None] Create snapshot completed successfully Aug 01 15:24:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9448d4-48f3-435e-91d9-e7f8fbd0719c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:55 devstack sudo[114319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d Aug 01 15:24:55 devstack sudo[114319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:55 devstack sudo[114319]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d" returned: 0 in 0.365s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:55 devstack sudo[114324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e 1G Aug 01 15:24:55 devstack sudo[114324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:56 devstack sudo[114324]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e 1G" returned: 0 in 0.411s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764ead27-6129-430f-97a1-4925035b736d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:56 devstack sudo[114329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764ead27-6129-430f-97a1-4925035b736d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e Aug 01 15:24:56 devstack sudo[114329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:56 devstack sudo[114329]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-764ead27-6129-430f-97a1-4925035b736d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e" returned: 0 in 0.299s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:56 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e is being set with open permissions: ugo+rw Aug 01 15:24:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:56 devstack sudo[114338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e Aug 01 15:24:56 devstack sudo[114338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:56 devstack sudo[114338]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e" returned: 0 in 0.242s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:56 devstack sudo[114347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.info Aug 01 15:24:56 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:56 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.info" returned: 0 in 0.292s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:56 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.info is being set with open permissions: ugo+rw Aug 01 15:24:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:57 devstack sudo[114350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.info Aug 01 15:24:57 devstack sudo[114350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:57 devstack sudo[114350]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.info" returned: 0 in 0.273s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.330s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840164427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0a9fc9-06df-4284-b1bb-2053a34f7402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:40Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Creating volume be0a9fc9-06df-4284-b1bb-2053a34f7402 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:57 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:57 devstack sudo[114353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 1073741824 Aug 01 15:24:57 devstack sudo[114353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:57 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ba4fcf78-ee09-4fa7-9451-d62cda4687ca tempest-VolumeImageDependencyTests-696602523 None] Create snapshot completed successfully Aug 01 15:24:57 devstack sudo[114353]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 1073741824" returned: 0 in 0.441s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:57 devstack sudo[114358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 Aug 01 15:24:57 devstack sudo[114358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:58 devstack sudo[114358]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402" returned: 0 in 0.257s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.946s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-266027266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:41Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Creating volume ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:24:58 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938c76ac-a32b-48f5-9800-4ca137776480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0a9fc9-06df-4284-b1bb-2053a34f7402', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92899e07-06bd-4904-9e75-b175047436d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:58 devstack sudo[114361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 1073741824 Aug 01 15:24:58 devstack sudo[114361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:58 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Volume volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 (be0a9fc9-06df-4284-b1bb-2053a34f7402): created successfully Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92899e07-06bd-4904-9e75-b175047436d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (11076255-7c1b-4574-854b-ee4e7420cace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:58 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-231ca281-a317-4b2d-860f-3405bdfe6ac7 tempest-ProjectMemberTests-660978679 None] Created volume successfully. Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Flow 'volume_create_manager' (bdab2015-e9e1-4e13-b360-fda412e979b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dd01bb-d939-404b-a8e6-0a56a1a1abf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:58 devstack sudo[114361]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 1073741824" returned: 0 in 0.470s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dd01bb-d939-404b-a8e6-0a56a1a1abf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-e6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5511938b-8c69-4d7b-b4e1-05d92433fcd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af2e0ac207a45e6805ffa6c60bc79c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03d07264-99f9-423b-8dbc-e1bf4f6d595e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:24:58Z,use_quota=True,user_id='ab05d4fdd2684209bf3a1016b2141261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091b2554-76bb-4dc7-b412-14af7c22b2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091b2554-76bb-4dc7-b412-14af7c22b2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad77424-3687-44b2-8236-11cdaa28459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ad77424-3687-44b2-8236-11cdaa28459d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5511938b-8c69-4d7b-b4e1-05d92433fcd9', 'volume_name': 'volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9', 'volume_size': 1, 'snapshot_id': '03d07264-99f9-423b-8dbc-e1bf4f6d595e'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f74847-be5b-4dc0-895d-2e95d28f8ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f74847-be5b-4dc0-895d-2e95d28f8ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79419b4-af3d-4a4f-a57e-05ea6bc1cf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:58 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Volume 5511938b-8c69-4d7b-b4e1-05d92433fcd9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9', 'volume_size': 1, 'snapshot_id': '03d07264-99f9-423b-8dbc-e1bf4f6d595e'} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:58 devstack sudo[114367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 Aug 01 15:24:58 devstack sudo[114367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:58 devstack sudo[114367]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" returned: 0 in 0.253s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.682s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0110fbf-2551-4408-8bdc-c2d10b0907a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb719dde-f800-4362-a7b0-ccc9db470bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Creating online snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 of volume 5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:24:58 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Volume volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 (ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1): created successfully Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb719dde-f800-4362-a7b0-ccc9db470bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (26992c3c-8b84-43b5-90f2-7a6f63a15129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[410570b8-cf81-431d-a6d5-eb48e6849f87]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:24:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:58 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-365222e8-b36b-4983-8fab-f83c21069894 tempest-VolumeDependencyTests-841441038 None] Created volume successfully. Aug 01 15:24:59 devstack sudo[114370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 Aug 01 15:24:59 devstack sudo[114370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:59 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=180,cinder:UPDATE=199,cinder:INSERT=73,cinder:DELETE=14 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:24:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:24:59 devstack sudo[114370]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50" returned: 0 in 0.443s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:24:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:59 devstack sudo[114376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 1G Aug 01 15:24:59 devstack sudo[114376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:24:59 devstack sudo[114376]: pam_unix(sudo:session): session closed for user root Aug 01 15:24:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 1G" returned: 0 in 0.406s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:24:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:24:59 devstack sudo[114381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 Aug 01 15:24:59 devstack sudo[114381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:00 devstack sudo[114381]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832" returned: 0 in 0.295s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:00 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is being set with open permissions: ugo+rw Aug 01 15:25:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:00 devstack sudo[114386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 Aug 01 15:25:00 devstack sudo[114386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:00 devstack sudo[114386]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:00 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:25:00 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] REQ: curl -g -i -X POST http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}ae50e8f1b146236afbf4743bcb0c859c7abb3a46d58131bd9fc2b2430dcec3ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0f8b711-b38b-4a62-bb52-3568bbfa3502" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" -d '{"snapshot": {"volume_id": "5194739a-d327-4411-ad5f-23e1c7cfc79e", "create_info": {"type": "qcow2", "new_file": "volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832", "snapshot_id": "cda4bdf3-fa9d-48fb-96fb-3a39e482f832"}}}' {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:25:00 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Sat, 01 Aug 2026 13:25:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fbcb980e-cce3-47bd-a327-7092e0211e0e x-openstack-request-id: req-fbcb980e-cce3-47bd-a327-7092e0211e0e {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:25:00 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "5194739a-d327-4411-ad5f-23e1c7cfc79e"}} {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 01 15:25:00 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] POST call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots used request id req-fbcb980e-cce3-47bd-a327-7092e0211e0e {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:25:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] nova call result: None {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 01 15:25:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:03 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=155,cinder:INSERT=53,cinder:UPDATE=165,cinder:DELETE=18 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:25:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:15 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 18.907s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 19.186s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-quobyte-03d07264-99f9-423b-8dbc-e1bf4f6d595e-5511938b-8c69-4d7b-b4e1-05d92433fcd9" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-03d07264-99f9-423b-8dbc-e1bf4f6d595e-5511938b-8c69-4d7b-b4e1-05d92433fcd9" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Creating volume 5511938b-8c69-4d7b-b4e1-05d92433fcd9 from snapshot 03d07264-99f9-423b-8dbc-e1bf4f6d595e {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-quobyte-5511938b-8c69-4d7b-b4e1-05d92433fcd9" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:17 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d0f8b711-b38b-4a62-bb52-3568bbfa3502 tempest-SnapshotDataIntegrityTests-992674527 None] Create snapshot completed successfully Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-5511938b-8c69-4d7b-b4e1-05d92433fcd9" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] snapshot: 03d07264-99f9-423b-8dbc-e1bf4f6d595e, volume: 5511938b-8c69-4d7b-b4e1-05d92433fcd9, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f947b2-6358-44d1-8d48-f894bbc009a3]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:17 devstack sudo[114824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e Aug 01 15:25:17 devstack sudo[114824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:18 devstack sudo[114824]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-764ead27-6129-430f-97a1-4925035b736d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[501b7e4e-3ab7-4ba9-b2ae-e68e21e33518]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:18 devstack sudo[114829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d Aug 01 15:25:18 devstack sudo[114829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:18 devstack sudo[114829]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d" returned: 0 in 0.367s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:18 devstack sudo[114834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 Aug 01 15:25:18 devstack sudo[114834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:18 devstack sudo[114835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:25:18 devstack sudo[114835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:18 devstack sudo[114835]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.264s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:25:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:25:19 devstack sudo[114834]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9" returned: 0 in 0.535s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:25:19 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 01 15:25:19 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 is being set with open permissions: ugo+rw Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:19 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 Aug 01 15:25:19 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:19 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9" returned: 0 in 0.256s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-5511938b-8c69-4d7b-b4e1-05d92433fcd9" released by "_copy_volume_from_snapshot" :: held 1.585s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-03d07264-99f9-423b-8dbc-e1bf4f6d595e-5511938b-8c69-4d7b-b4e1-05d92433fcd9" released by "_create_volume_from_snapshot" :: held 1.665s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.689s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 20.209s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] Creating offline snapshot 4bf711e5-45af-418e-92a6-4406ac8a3b79 of volume be0a9fc9-06df-4284-b1bb-2053a34f7402 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG cinder.volume.volume_utils [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Marking volume 5511938b-8c69-4d7b-b4e1-05d92433fcd9 as bootable. {{(pid=89024) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Copying metadata from snapshot 03d07264-99f9-423b-8dbc-e1bf4f6d595e to 5511938b-8c69-4d7b-b4e1-05d92433fcd9. {{(pid=89024) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5500839c-e1b3-408d-bea3-879d246334de]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79419b4-af3d-4a4f-a57e-05ea6bc1cf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9', 'volume_size': 1, 'snapshot_id': '03d07264-99f9-423b-8dbc-e1bf4f6d595e'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3621e36d-958f-4db5-917a-dc9c4cf0abab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:19 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Volume volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 (5511938b-8c69-4d7b-b4e1-05d92433fcd9): created successfully Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3621e36d-958f-4db5-917a-dc9c4cf0abab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Flow 'volume_create_manager' (bdab2015-e9e1-4e13-b360-fda412e979b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:25:19 devstack sudo[114856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 Aug 01 15:25:19 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-77b4d4fd-7c1b-44ea-a3a1-49a6812797ff tempest-VolumeImageDependencyTests-696602523 None] Created volume successfully. Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:19 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402" returned: 0 in 0.391s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:19 devstack sudo[114861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 1G Aug 01 15:25:19 devstack sudo[114861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:20 devstack sudo[114861]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 1G" returned: 0 in 0.373s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:20 devstack sudo[114867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 Aug 01 15:25:20 devstack sudo[114867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:20 devstack sudo[114867]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79" returned: 0 in 0.292s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:20 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 is being set with open permissions: ugo+rw Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:20 devstack sudo[114872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 Aug 01 15:25:20 devstack sudo[114872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-03d07264-99f9-423b-8dbc-e1bf4f6d595e-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-03d07264-99f9-423b-8dbc-e1bf4f6d595e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-quobyte-764ead27-6129-430f-97a1-4925035b736d" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-764ead27-6129-430f-97a1-4925035b736d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-quobyte-03d07264-99f9-423b-8dbc-e1bf4f6d595e" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-03d07264-99f9-423b-8dbc-e1bf4f6d595e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Deleting offline snapshot 03d07264-99f9-423b-8dbc-e1bf4f6d595e of volume 764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] snapshot_file for this snap is: volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e99430-f97a-45c3-a652-24bdb493ab0c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:20 devstack sudo[114872]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79" returned: 0 in 0.277s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:20 devstack sudo[114876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.info Aug 01 15:25:20 devstack sudo[114876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:20 devstack sudo[114875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e Aug 01 15:25:20 devstack sudo[114875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:21 devstack sudo[114876]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.info" returned: 0 in 0.265s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:21 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.info is being set with open permissions: ugo+rw Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:21 devstack sudo[114882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.info Aug 01 15:25:21 devstack sudo[114882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:21 devstack sudo[114875]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e" returned: 0 in 0.379s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-764ead27-6129-430f-97a1-4925035b736d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[33252480-67b9-4563-8c3b-f6313b723818]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:21 devstack sudo[114885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d Aug 01 15:25:21 devstack sudo[114885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:21 devstack sudo[114882]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.info" returned: 0 in 0.282s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 22.156s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] Creating offline snapshot f13dffdf-30ed-48a9-b36a-3cac20f348e9 of volume ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:25:21 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b7271cac-5614-4029-88f4-ce93092c34e5 tempest-ProjectMemberTests-660978679 None] Create snapshot completed successfully Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[55517864-7304-4f1a-ae01-3eb619aaec44]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:21 devstack sudo[114922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 Aug 01 15:25:21 devstack sudo[114885]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:21 devstack sudo[114922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d" returned: 0 in 0.413s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:21 devstack sudo[114927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e Aug 01 15:25:21 devstack sudo[114927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:21 devstack sudo[114922]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" returned: 0 in 0.408s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-4bf711e5-45af-418e-92a6-4406ac8a3b79-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:21 devstack sudo[114936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 1G Aug 01 15:25:21 devstack sudo[114936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Lock "cinder-4bf711e5-45af-418e-92a6-4406ac8a3b79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-be0a9fc9-06df-4284-b1bb-2053a34f7402" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-be0a9fc9-06df-4284-b1bb-2053a34f7402" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-4bf711e5-45af-418e-92a6-4406ac8a3b79" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-4bf711e5-45af-418e-92a6-4406ac8a3b79" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Deleting offline snapshot 4bf711e5-45af-418e-92a6-4406ac8a3b79 of volume be0a9fc9-06df-4284-b1bb-2053a34f7402 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] snapshot_file for this snap is: volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cd978c-bae0-4fe4-97df-7db8249c2269]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:22 devstack sudo[114927]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e" returned: 0 in 0.438s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:22 devstack sudo[114940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e Aug 01 15:25:22 devstack sudo[114940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:22 devstack sudo[114939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 Aug 01 15:25:22 devstack sudo[114939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:22 devstack sudo[114936]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 1G" returned: 0 in 0.457s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:22 devstack sudo[114940]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d.03d07264-99f9-423b-8dbc-e1bf4f6d595e" returned: 0 in 0.308s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:22 devstack sudo[114950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 Aug 01 15:25:22 devstack sudo[114950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-03d07264-99f9-423b-8dbc-e1bf4f6d595e" released by "_delete_snapshot" :: held 1.662s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:22 devstack sudo[114939]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-764ead27-6129-430f-97a1-4925035b736d" released by "delete_snapshot" :: held 1.691s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79" returned: 0 in 0.416s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0a9fc9-06df-4284-b1bb-2053a34f7402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9173d5-f8db-426a-bbd3-485d993d9638]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Created reservations ['cf1f2aad-6272-4fcc-97b6-06d4b6975bf9', '961899b2-650b-4a2a-aaef-2bd60232dc32', '7f9b7010-de2a-4f46-b929-81b5163b940b', 'f3b0325d-b9f2-4080-8195-70c4a992c1b3'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:25:22 devstack sudo[114953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 Aug 01 15:25:22 devstack sudo[114953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:22 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Delete snapshot completed successfully. Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-25d4ac37-e9dc-4284-bbe0-e759a3052ff8 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-03d07264-99f9-423b-8dbc-e1bf4f6d595e-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:22 devstack sudo[114950]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9" returned: 0 in 0.330s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:22 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 is being set with open permissions: ugo+rw Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:22 devstack sudo[114958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 Aug 01 15:25:22 devstack sudo[114958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-5511938b-8c69-4d7b-b4e1-05d92433fcd9-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:22 devstack sudo[114953]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402" returned: 0 in 0.448s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-5511938b-8c69-4d7b-b4e1-05d92433fcd9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:22 devstack sudo[114965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 Aug 01 15:25:22 devstack sudo[114965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-quobyte-5511938b-8c69-4d7b-b4e1-05d92433fcd9" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-5511938b-8c69-4d7b-b4e1-05d92433fcd9" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:23 devstack sudo[114958]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9" returned: 0 in 0.347s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a879c91e-6a91-46a9-bff1-508cb5e384c0]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:23 devstack sudo[114968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.info Aug 01 15:25:23 devstack sudo[114968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:23 devstack sudo[114967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 Aug 01 15:25:23 devstack sudo[114967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:23 devstack sudo[114965]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79" returned: 0 in 0.396s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:23 devstack sudo[114981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79 Aug 01 15:25:23 devstack sudo[114981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:23 devstack sudo[114968]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.info" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:23 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.info is being set with open permissions: ugo+rw Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:23 devstack sudo[114985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.info Aug 01 15:25:23 devstack sudo[114985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:23 devstack sudo[114967]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9" returned: 0 in 0.415s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:23 devstack sudo[114989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9 Aug 01 15:25:23 devstack sudo[114989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:23 devstack sudo[114981]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402.4bf711e5-45af-418e-92a6-4406ac8a3b79" returned: 0 in 0.259s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-4bf711e5-45af-418e-92a6-4406ac8a3b79" released by "_delete_snapshot" :: held 1.632s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-be0a9fc9-06df-4284-b1bb-2053a34f7402" released by "delete_snapshot" :: held 1.660s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:23 devstack sudo[114985]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.info" returned: 0 in 0.281s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.913s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4b70e194-d7cf-4c2a-9e7e-515200b792da tempest-VolumeDependencyTests-841441038 None] Create snapshot completed successfully Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Creating online snapshot a4257430-12a7-449c-b348-2ea91037d7bb of volume 5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:25:23 devstack sudo[114989]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5511938b-8c69-4d7b-b4e1-05d92433fcd9" returned: 0 in 0.297s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[12148422-852e-4358-9848-d240c6daef31]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-5511938b-8c69-4d7b-b4e1-05d92433fcd9" released by "delete_volume" :: held 0.765s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Created reservations ['47c7de19-05e7-4163-a8c5-da5fb3e3f789', '4a013bd4-83d7-43f2-85d2-0e0b93aff9d9', '34816c29-2e45-46f2-9c7b-bdfd217cb9ef', '2af5aa74-ead0-47e7-86ec-b02b0c143782'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Created reservations ['ffa494d9-8cf4-443c-8d87-0755ee1a9a35', '18f1a40e-ed6c-4d75-9e35-57d798e4ff13', '66018f82-0917-47bd-922b-879566dce3da', 'cd0a4c1a-7461-41d4-b9b9-63a05eebbf90'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:25:23 devstack sudo[114994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 Aug 01 15:25:23 devstack sudo[114994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Delete snapshot completed successfully. Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d9f37f72-1071-4d39-b3bf-8181f8f48eea tempest-ProjectMemberTests-660978679 None] Lock "cinder-4bf711e5-45af-418e-92a6-4406ac8a3b79-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:23 devstack sudo[114996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:25:23 devstack sudo[114996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-be0a9fc9-06df-4284-b1bb-2053a34f7402-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Lock "cinder-be0a9fc9-06df-4284-b1bb-2053a34f7402-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:24 devstack sudo[114994]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832" returned: 0 in 0.511s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:24 devstack sudo[114996]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.365s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:25:24 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Deleted volume successfully. Aug 01 15:25:24 devstack sudo[115002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb 1G Aug 01 15:25:24 devstack sudo[115002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0e1fb1f2-195a-4ee1-aecc-4ff9e8f93773 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-5511938b-8c69-4d7b-b4e1-05d92433fcd9-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-be0a9fc9-06df-4284-b1bb-2053a34f7402" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-764ead27-6129-430f-97a1-4925035b736d-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-be0a9fc9-06df-4284-b1bb-2053a34f7402" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-764ead27-6129-430f-97a1-4925035b736d-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3174f57b-f775-46a9-ba3b-bccf588380cb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-quobyte-764ead27-6129-430f-97a1-4925035b736d" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-764ead27-6129-430f-97a1-4925035b736d" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fef313-adc7-4699-8f93-b9aebfe61448]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:24 devstack sudo[115004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 Aug 01 15:25:24 devstack sudo[115004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:24 devstack sudo[115005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d Aug 01 15:25:24 devstack sudo[115005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (65720beb-0126-4689-84c6-21977f498924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a71e13-915d-4d4d-9bf5-29223c2f101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a71e13-915d-4d4d-9bf5-29223c2f101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-272180557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d7257c7f07480c833cc9b2cd5fbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f13dffdf-30ed-48a9-b36a-3cac20f348e9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:25:25Z,use_quota=True,user_id='67044cec641c438a9453b2faf70aa322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67f9854-01a3-48ae-8f4b-5e193c37f162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:25 devstack sudo[115002]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67f9854-01a3-48ae-8f4b-5e193c37f162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81bb29d-ab67-42e7-961b-fd6264b482f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:25 devstack sudo[115004]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81bb29d-ab67-42e7-961b-fd6264b482f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef', 'volume_name': 'volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef', 'volume_size': 1, 'snapshot_id': 'f13dffdf-30ed-48a9-b36a-3cac20f348e9'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d0a53d-1b8b-45a0-a270-84c0c1efecf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d0a53d-1b8b-45a0-a270-84c0c1efecf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50548a8b-2a90-4fdc-a862-3d322d004c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:25 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Volume 9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef', 'volume_size': 1, 'snapshot_id': 'f13dffdf-30ed-48a9-b36a-3cac20f348e9'} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb 1G" returned: 0 in 0.738s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402" returned: 0 in 0.568s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:25 devstack sudo[115016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb Aug 01 15:25:25 devstack sudo[115016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:25 devstack sudo[115018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402 Aug 01 15:25:25 devstack sudo[115018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:25 devstack sudo[115005]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d" returned: 0 in 0.507s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:25 devstack sudo[115023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d Aug 01 15:25:25 devstack sudo[115023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:25 devstack sudo[115018]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-be0a9fc9-06df-4284-b1bb-2053a34f7402" returned: 0 in 0.286s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:25 devstack sudo[115016]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb" returned: 0 in 0.311s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:25 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb is being set with open permissions: ugo+rw Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-be0a9fc9-06df-4284-b1bb-2053a34f7402" released by "delete_volume" :: held 0.962s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:25 devstack sudo[115029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb Aug 01 15:25:25 devstack sudo[115029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:25 devstack sudo[115023]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-764ead27-6129-430f-97a1-4925035b736d" returned: 0 in 0.283s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-764ead27-6129-430f-97a1-4925035b736d" released by "delete_volume" :: held 0.868s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Created reservations ['1ac932e6-2d90-438f-ba2d-0b452e11d47f', '89c83964-0f5a-476c-a49e-3c50847c7a71', '15933e61-f8d4-4e21-8135-536bf372665c', '57d90773-1879-4dfc-a0d1-0bd517092a5e'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Created reservations ['321cb459-bcf3-452e-aa30-581040d488db', 'a1816afc-acec-481d-ac0d-8444f2039d7f', 'fef620d7-9209-4066-8491-b4c8bfede676', 'f1c757d5-9d27-4703-8f58-3c573bd7cb13'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:25 devstack sudo[115032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:25:25 devstack sudo[115032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:25 devstack sudo[115029]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb" returned: 0 in 0.293s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.compute.nova [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Creating Keystone auth plugin from conf {{(pid=89024) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:25 devstack sudo[115035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:25:25 devstack sudo[115035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] REQ: curl -g -i -X POST http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}dc98ddc7e50447c364447a068bdf85795d0bb2a754c6c9a0d34d08ff23474dd8" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a487777b-cff4-4b9e-b34a-1c0c58c65317" -H "X-Service-Token: {SHA256}eee5c48922b7e3d2765d8296c03824bd59feb1b7d30a7f7dcf196b22b57a302d" -d '{"snapshot": {"volume_id": "5194739a-d327-4411-ad5f-23e1c7cfc79e", "create_info": {"type": "qcow2", "new_file": "volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb", "snapshot_id": "a4257430-12a7-449c-b348-2ea91037d7bb"}}}' {{(pid=89024) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 01 15:25:25 devstack sudo[115032]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.410s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:25 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:25:25 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Deleted volume successfully. Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ca564fb-ce41-4910-8064-e50d07683c75 tempest-ProjectMemberTests-660978679 None] Lock "cinder-be0a9fc9-06df-4284-b1bb-2053a34f7402-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Sat, 01 Aug 2026 13:25:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19ab2c05-1b27-4f38-b5bd-6ae312b5afc4 x-openstack-request-id: req-19ab2c05-1b27-4f38-b5bd-6ae312b5afc4 {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "5194739a-d327-4411-ad5f-23e1c7cfc79e"}} {{(pid=89024) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG novaclient.v2.client [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] POST call to compute for http://192.168.122.171/compute/v2.1/os-assisted-volume-snapshots used request id req-19ab2c05-1b27-4f38-b5bd-6ae312b5afc4 {{(pid=89024) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] nova call result: None {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:26 devstack sudo[115035]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.436s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:25:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Deleted volume successfully. Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-82351e95-d5fd-4100-b15b-2c64e3fa29a1-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8856b20a-0d9d-4f16-951d-ccfc8e991623 tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-764ead27-6129-430f-97a1-4925035b736d-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-82351e95-d5fd-4100-b15b-2c64e3fa29a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "cinder-quobyte-82351e95-d5fd-4100-b15b-2c64e3fa29a1" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-82351e95-d5fd-4100-b15b-2c64e3fa29a1" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a87963-63a2-4720-ad24-769a17179a28]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (355c65a4-1592-4cbd-be2c-0566d4ab7acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5c850b-040d-4f86-9e33-ab7075dee413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5c850b-040d-4f86-9e33-ab7075dee413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41391473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c83eca-e16a-4a84-bc5c-7da70f47068d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:25:26Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbd9e2e-a11c-4291-a1c6-1f26c5744b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbd9e2e-a11c-4291-a1c6-1f26c5744b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530d3040-088a-43c6-953b-b8b70cdece18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530d3040-088a-43c6-953b-b8b70cdece18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c83eca-e16a-4a84-bc5c-7da70f47068d', 'volume_name': 'volume-53c83eca-e16a-4a84-bc5c-7da70f47068d', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca7341f-fd4b-4e5d-b103-f96ceebd032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca7341f-fd4b-4e5d-b103-f96ceebd032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:26 devstack sudo[115040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 Aug 01 15:25:26 devstack sudo[115040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c708e8-3561-4cea-af5d-6e087892d233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:26 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Volume 53c83eca-e16a-4a84-bc5c-7da70f47068d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c83eca-e16a-4a84-bc5c-7da70f47068d', 'volume_size': 1} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:26 devstack sudo[115040]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1" returned: 0 in 0.381s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:26 devstack sudo[115050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1 Aug 01 15:25:26 devstack sudo[115050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:26 devstack sudo[115050]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-82351e95-d5fd-4100-b15b-2c64e3fa29a1" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-quobyte-82351e95-d5fd-4100-b15b-2c64e3fa29a1" released by "delete_volume" :: held 0.681s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:26 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Created reservations ['a9c905b0-c6e5-45a5-bbb2-8b903d238f8d', '373adaeb-ccdf-48f6-9967-e38731d21962', '4ee9dbc7-24d3-47ff-b54c-b883634e1d33', 'f80a7849-5ae4-4412-8e90-6fe4a7891076'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:25:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:27 devstack sudo[115053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:25:27 devstack sudo[115053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:27 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:27 devstack sudo[115053]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.265s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:27 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:25:27 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Deleted volume successfully. Aug 01 15:25:27 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9705f238-e42a-4886-a203-fe4f028ee6ba tempest-VolumeImageDependencyTests-696602523 None] Lock "cinder-82351e95-d5fd-4100-b15b-2c64e3fa29a1-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Flow 'volume_create_manager' (b7fd7aec-3940-4926-9c77-061c84968e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b587d436-7996-4548-911f-57e2e41fa8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b587d436-7996-4548-911f-57e2e41fa8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f3ce4a-227a-44b8-8cde-9c635927bd1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d291121e13a7470885ef66132e80172a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:25:30Z,use_quota=True,user_id='e27db8461bd644f4a5e981b9106ac5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501efffa-c456-4a65-9185-94f4bd79835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501efffa-c456-4a65-9185-94f4bd79835a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abd6baa-4847-4afc-8967-f7a6dc91831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abd6baa-4847-4afc-8967-f7a6dc91831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f3ce4a-227a-44b8-8cde-9c635927bd1e', 'volume_name': 'volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fddfb2e8-9ee6-4997-8b21-17ee78feff25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fddfb2e8-9ee6-4997-8b21-17ee78feff25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27940bf-9f06-461c-845b-b65499282f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:30 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Volume c0f3ce4a-227a-44b8-8cde-9c635927bd1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e', 'volume_size': 1} Aug 01 15:25:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:34 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Status of snapshot a4257430-12a7-449c-b348-2ea91037d7bb is now creating {{(pid=89024) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.589s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 18.210s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-f13dffdf-30ed-48a9-b36a-3cac20f348e9-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-f13dffdf-30ed-48a9-b36a-3cac20f348e9-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Creating volume 9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef from snapshot f13dffdf-30ed-48a9-b36a-3cac20f348e9 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a487777b-cff4-4b9e-b34a-1c0c58c65317 tempest-SnapshotDataIntegrityTests-992674527 None] Create snapshot completed successfully Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] snapshot: f13dffdf-30ed-48a9-b36a-3cac20f348e9, volume: 9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede561d7-61bb-46a9-8bfb-d91020d02eb3]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:43 devstack sudo[115062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 Aug 01 15:25:43 devstack sudo[115062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:43 devstack sudo[115062]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9" returned: 0 in 0.387s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[237d6f08-0e88-43ca-a20e-5373d16561f2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:43 devstack sudo[115067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 Aug 01 15:25:43 devstack sudo[115067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:44 devstack sudo[115067]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" returned: 0 in 0.404s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:25:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:25:44 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:25:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:44 devstack sudo[115072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef Aug 01 15:25:44 devstack sudo[115072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:44 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-cddd4a66-13af-445d-a6c9-cd25dd03cd9e req-ea6009dd-f27b-4f0b-b436-ffe6a52d8e59 tempest-SnapshotDataIntegrityTests-992674527 None] Terminate volume connection completed successfully. Aug 01 15:25:44 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-cddd4a66-13af-445d-a6c9-cd25dd03cd9e req-ea6009dd-f27b-4f0b-b436-ffe6a52d8e59 tempest-SnapshotDataIntegrityTests-992674527 None] Deleting attachment ebd4e122-22b5-4956-b775-4eaab3236b6c. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Flow 'volume_create_manager' (9063cf96-29e5-4b1a-896c-7c686983952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b08c17-6d05-48bc-8c48-638bee578d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b08c17-6d05-48bc-8c48-638bee578d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-161265227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39f0131-2018-46dc-a3af-2fe4c56f3687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a9664c1f624484b86a04352731e3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c00346e-7d5d-4b93-92ce-c40efc28fb50,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:25:47Z,use_quota=True,user_id='74ce19bc1ce44396b6596da7499917d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4aef42-46ca-4287-837c-f027e112bf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4aef42-46ca-4287-837c-f027e112bf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86806201-414f-4681-875f-67b9e1bfda04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86806201-414f-4681-875f-67b9e1bfda04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e39f0131-2018-46dc-a3af-2fe4c56f3687', 'volume_name': 'volume-e39f0131-2018-46dc-a3af-2fe4c56f3687', 'volume_size': 1, 'snapshot_id': '1c00346e-7d5d-4b93-92ce-c40efc28fb50'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491d7e4f-b12a-4f15-9669-9c7dd9e1f90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491d7e4f-b12a-4f15-9669-9c7dd9e1f90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02fbc77-9a1a-44ec-8ac0-e953f77d0d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Volume e39f0131-2018-46dc-a3af-2fe4c56f3687: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e39f0131-2018-46dc-a3af-2fe4c56f3687', 'volume_size': 1, 'snapshot_id': '1c00346e-7d5d-4b93-92ce-c40efc28fb50'} Aug 01 15:25:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:48 devstack sudo[115072]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" returned: 0 in 4.687s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:48 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:25:48 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Converted 1024.00 MB image at 218.45 MB/s Aug 01 15:25:48 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef is being set with open permissions: ugo+rw Aug 01 15:25:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:48 devstack sudo[115091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef Aug 01 15:25:48 devstack sudo[115091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:49 devstack sudo[115091]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" returned: 0 in 0.241s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" released by "_copy_volume_from_snapshot" :: held 5.821s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-f13dffdf-30ed-48a9-b36a-3cac20f348e9-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" released by "_create_volume_from_snapshot" :: held 5.895s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.917s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.810s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41391473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c83eca-e16a-4a84-bc5c-7da70f47068d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:25:26Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Creating volume 53c83eca-e16a-4a84-bc5c-7da70f47068d {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:25:49 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:49 devstack sudo[115094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d 1073741824 Aug 01 15:25:49 devstack sudo[115094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50548a8b-2a90-4fdc-a862-3d322d004c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef', 'volume_size': 1, 'snapshot_id': 'f13dffdf-30ed-48a9-b36a-3cac20f348e9'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4ec86a-f044-4b14-86e2-472543dd157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:49 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Volume volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef (9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef): created successfully Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4ec86a-f044-4b14-86e2-472543dd157c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Flow 'volume_create_manager' (65720beb-0126-4689-84c6-21977f498924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:25:49 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-54ee15a9-890a-4d47-a537-199e2c839f5e tempest-VolumeDependencyTests-841441038 None] Created volume successfully. Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-f13dffdf-30ed-48a9-b36a-3cac20f348e9-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-f13dffdf-30ed-48a9-b36a-3cac20f348e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-f13dffdf-30ed-48a9-b36a-3cac20f348e9" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-f13dffdf-30ed-48a9-b36a-3cac20f348e9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Deleting offline snapshot f13dffdf-30ed-48a9-b36a-3cac20f348e9 of volume ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] snapshot_file for this snap is: volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[345eabe9-2367-4b8d-8583-c13a412bde47]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:49 devstack sudo[115094]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d 1073741824" returned: 0 in 0.467s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:49 devstack sudo[115101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d Aug 01 15:25:49 devstack sudo[115101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:49 devstack sudo[115100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 Aug 01 15:25:49 devstack sudo[115100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:49 devstack sudo[115101]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d" returned: 0 in 0.260s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.594s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f3ce4a-227a-44b8-8cde-9c635927bd1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d291121e13a7470885ef66132e80172a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:25:30Z,use_quota=True,user_id='e27db8461bd644f4a5e981b9106ac5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Creating volume c0f3ce4a-227a-44b8-8cde-9c635927bd1e {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:25:50 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:50 devstack sudo[115100]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9" returned: 0 in 0.389s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:25:50 devstack sudo[115108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e 1073741824 Aug 01 15:25:50 devstack sudo[115108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c708e8-3561-4cea-af5d-6e087892d233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c83eca-e16a-4a84-bc5c-7da70f47068d', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acce4f0-65e5-42a7-878c-0578bf101930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6828e6-c423-4d27-9337-afba96dd7559]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:50 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Volume volume-53c83eca-e16a-4a84-bc5c-7da70f47068d (53c83eca-e16a-4a84-bc5c-7da70f47068d): created successfully Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acce4f0-65e5-42a7-878c-0578bf101930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (355c65a4-1592-4cbd-be2c-0566d4ab7acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:25:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-605b3000-0db7-4b07-b958-8e65a34b625d tempest-ProjectMemberTests-660978679 None] Created volume successfully. Aug 01 15:25:50 devstack sudo[115110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 Aug 01 15:25:50 devstack sudo[115110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:50 devstack sudo[115108]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e 1073741824" returned: 0 in 0.426s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:50 devstack sudo[115119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e Aug 01 15:25:50 devstack sudo[115119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:50 devstack sudo[115110]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" returned: 0 in 0.571s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:50 devstack sudo[115122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 Aug 01 15:25:50 devstack sudo[115122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:50 devstack sudo[115119]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e" returned: 0 in 0.258s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.943s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-1c00346e-7d5d-4b93-92ce-c40efc28fb50-e39f0131-2018-46dc-a3af-2fe4c56f3687" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27940bf-9f06-461c-845b-b65499282f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a2ee6e-a4bf-4946-b4c0-4d5f738b68c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-1c00346e-7d5d-4b93-92ce-c40efc28fb50-e39f0131-2018-46dc-a3af-2fe4c56f3687" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Creating volume e39f0131-2018-46dc-a3af-2fe4c56f3687 from snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-e39f0131-2018-46dc-a3af-2fe4c56f3687" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:50 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Volume volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e (c0f3ce4a-227a-44b8-8cde-9c635927bd1e): created successfully Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a2ee6e-a4bf-4946-b4c0-4d5f738b68c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Flow 'volume_create_manager' (b7fd7aec-3940-4926-9c77-061c84968e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-e39f0131-2018-46dc-a3af-2fe4c56f3687" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] snapshot: 1c00346e-7d5d-4b93-92ce-c40efc28fb50, volume: e39f0131-2018-46dc-a3af-2fe4c56f3687, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-15238132-4beb-4be4-9c37-2b6a2b3727c8 tempest-CinderUnicodeTest-1909134897 None] Created volume successfully. Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc3e160-a20b-44af-982e-a7a6b40c71b2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:50 devstack sudo[115127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 Aug 01 15:25:50 devstack sudo[115127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:51 devstack sudo[115122]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9" returned: 0 in 0.397s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:51 devstack sudo[115131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9 Aug 01 15:25:51 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:51 devstack sudo[115127]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50" returned: 0 in 0.384s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ef6908-136e-4307-bb93-acdb217ca050]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:51 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1.f13dffdf-30ed-48a9-b36a-3cac20f348e9" returned: 0 in 0.280s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-f13dffdf-30ed-48a9-b36a-3cac20f348e9" released by "_delete_snapshot" :: held 1.749s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" released by "delete_snapshot" :: held 1.772s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:51 devstack sudo[115137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e Aug 01 15:25:51 devstack sudo[115137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Created reservations ['11f86258-38af-4517-8058-dc95613df20b', 'e49fb4f1-03b0-4566-80a8-9bc46d9a2f8f', '14d8f97c-7897-4995-a955-5af566840b2e', '6098ea97-f9d0-47c2-ae4f-9fad440f26ab'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:25:51 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Delete snapshot completed successfully. Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7ee379d2-2409-441d-bb65-e82448ba4795 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-f13dffdf-30ed-48a9-b36a-3cac20f348e9-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:51 devstack sudo[115137]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e" returned: 0 in 0.368s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:51 devstack sudo[115142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 Aug 01 15:25:51 devstack sudo[115142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" acquired by "delete_volume" :: waited 0.035s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a85268-b001-49c6-850c-7e18bcb9562a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:51 devstack sudo[115146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 Aug 01 15:25:51 devstack sudo[115146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:25:52 devstack sudo[115146]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Flow 'volume_create_manager' (cf77cc97-8cd1-4bed-b8c3-72574a4ddca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8423a3-6e9d-4ef8-9078-6a2a312ddf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" returned: 0 in 0.778s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:52 devstack sudo[115159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1 Aug 01 15:25:52 devstack sudo[115159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8423a3-6e9d-4ef8-9078-6a2a312ddf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:25:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1189994651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf83d72-99ec-46aa-92ff-ff204649150e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d291121e13a7470885ef66132e80172a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:25:52Z,use_quota=True,user_id='e27db8461bd644f4a5e981b9106ac5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e71947-9b30-4d44-92e3-68ebe5dba9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e71947-9b30-4d44-92e3-68ebe5dba9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c865a91-fa37-435b-917d-25efd2bb04ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c865a91-fa37-435b-917d-25efd2bb04ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf83d72-99ec-46aa-92ff-ff204649150e', 'volume_name': 'volume-3bf83d72-99ec-46aa-92ff-ff204649150e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed7bb4c-a7ec-4a51-a188-6f38ab518681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed7bb4c-a7ec-4a51-a188-6f38ab518681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bed9ba-22ff-406b-b64e-da0bc617dded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Volume 3bf83d72-99ec-46aa-92ff-ff204649150e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf83d72-99ec-46aa-92ff-ff204649150e', 'volume_size': 1} Aug 01 15:25:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:53 devstack sudo[115159]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" returned: 0 in 0.381s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1" released by "delete_volume" :: held 1.272s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Created reservations ['22ec7bfa-5084-412a-a2c3-2d778c546fe9', '4add82d3-4b3d-4fd0-aa46-ddd77b733df1', 'bc55fd2c-1dbb-417d-90b1-0c485fac49da', '48de084e-98f3-41d8-8563-d00bf4b451cc'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:53 devstack sudo[115162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:25:53 devstack sudo[115162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:53 devstack sudo[115162]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.522s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:25:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Deleted volume successfully. Aug 01 15:25:53 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-5b866c18-9334-43e4-b448-f2e87d3cac53 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-ed1a6404-7531-4d3b-9a2b-f7f4027e8fa1-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "cinder-quobyte-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:54 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" acquired by "delete_volume" :: waited 0.040s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:54 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[059441f3-54a5-4935-8cd0-a6fc08db715e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:54 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:54 devstack sudo[115166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef Aug 01 15:25:54 devstack sudo[115166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:55 devstack sudo[115166]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" returned: 0 in 0.808s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:55 devstack sudo[115171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef Aug 01 15:25:55 devstack sudo[115171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:55 devstack sudo[115171]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" returned: 0 in 0.493s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:55 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-quobyte-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef" released by "delete_volume" :: held 1.409s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:55 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Created reservations ['a8563518-2a35-43ba-8c71-8b7f67f3dc79', 'd5e9359e-994d-4cf5-8aae-6f1ff58224e8', 'e52bed82-4a82-4019-baf9-fd3748f7c2bd', '1571e2d7-9c11-4747-b0c2-1d03d9d57d3c'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:56 devstack sudo[115174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:25:56 devstack sudo[115174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:56 devstack sudo[115174]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.410s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:25:56 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Deleted volume successfully. Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-cc737e2b-ab29-46c2-8bfa-fd1750c88f92 tempest-VolumeDependencyTests-841441038 None] Lock "cinder-9fc74dc6-09d8-45ba-9798-0f8c4a1b99ef-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:56 devstack sudo[115142]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687" returned: 0 in 5.092s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:25:56 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Converted 1024.00 MB image at 201.06 MB/s Aug 01 15:25:56 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 is being set with open permissions: ugo+rw Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:56 devstack sudo[115177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 Aug 01 15:25:56 devstack sudo[115177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:56 devstack sudo[115177]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687" returned: 0 in 0.261s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-e39f0131-2018-46dc-a3af-2fe4c56f3687" released by "_copy_volume_from_snapshot" :: held 6.192s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-1c00346e-7d5d-4b93-92ce-c40efc28fb50-e39f0131-2018-46dc-a3af-2fe4c56f3687" released by "_create_volume_from_snapshot" :: held 6.282s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.326s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.849s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] Creating offline snapshot e1656a0c-b13f-4d48-b39a-df896592bd4b of volume 53c83eca-e16a-4a84-bc5c-7da70f47068d {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02fbc77-9a1a-44ec-8ac0-e953f77d0d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39f0131-2018-46dc-a3af-2fe4c56f3687', 'volume_size': 1, 'snapshot_id': '1c00346e-7d5d-4b93-92ce-c40efc28fb50'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e2a17a-cf1b-4b97-a972-8f1214af0766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a754000c-e797-4416-aaa9-e7c5e3af47ac]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:57 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Volume volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 (e39f0131-2018-46dc-a3af-2fe4c56f3687): created successfully Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e2a17a-cf1b-4b97-a972-8f1214af0766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Flow 'volume_create_manager' (9063cf96-29e5-4b1a-896c-7c686983952f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:25:57 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6a22d0f7-a9a5-468e-9eed-a1de7037b73b tempest-SnapshotDataIntegrityTests-992674527 None] Created volume successfully. Aug 01 15:25:57 devstack sudo[115180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d Aug 01 15:25:57 devstack sudo[115180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:57 devstack sudo[115180]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d" returned: 0 in 0.391s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:57 devstack sudo[115185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b 1G Aug 01 15:25:57 devstack sudo[115185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:57 devstack sudo[115185]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b 1G" returned: 0 in 0.490s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c83eca-e16a-4a84-bc5c-7da70f47068d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:58 devstack sudo[115195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c83eca-e16a-4a84-bc5c-7da70f47068d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b Aug 01 15:25:58 devstack sudo[115195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:58 devstack sudo[115195]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c83eca-e16a-4a84-bc5c-7da70f47068d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b" returned: 0 in 0.385s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:58 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b is being set with open permissions: ugo+rw Aug 01 15:25:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:58 devstack sudo[115203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b Aug 01 15:25:58 devstack sudo[115203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:58 devstack sudo[115203]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b" returned: 0 in 0.315s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:58 devstack sudo[115206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.info Aug 01 15:25:58 devstack sudo[115206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:59 devstack sudo[115206]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.info" returned: 0 in 0.314s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:59 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.info is being set with open permissions: ugo+rw Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-4b5ec140-2dbf-42dd-9310-b30bcaf43b11 req-a7adb972-79a3-4cb8-a81f-3bb8490dbb09 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:59 devstack sudo[115217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.info Aug 01 15:25:59 devstack sudo[115217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:59 devstack sudo[115217]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.info" returned: 0 in 0.267s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.499s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:25:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1189994651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf83d72-99ec-46aa-92ff-ff204649150e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d291121e13a7470885ef66132e80172a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:25:52Z,use_quota=True,user_id='e27db8461bd644f4a5e981b9106ac5c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Creating volume 3bf83d72-99ec-46aa-92ff-ff204649150e {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:25:59 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:59 devstack sudo[115220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e 1073741824 Aug 01 15:25:59 devstack sudo[115220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-35379ea9-fee1-4ef4-8a3d-d80d93ab45d1 tempest-ProjectMemberTests-660978679 None] Create snapshot completed successfully Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=91,cinder:UPDATE=88,cinder:DELETE=11,cinder:INSERT=28 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:25:59 devstack sudo[115220]: pam_unix(sudo:session): session closed for user root Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e 1073741824" returned: 0 in 0.473s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-e1656a0c-b13f-4d48-b39a-df896592bd4b-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:59 devstack sudo[115226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e Aug 01 15:25:59 devstack sudo[115226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Lock "cinder-e1656a0c-b13f-4d48-b39a-df896592bd4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-53c83eca-e16a-4a84-bc5c-7da70f47068d" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-53c83eca-e16a-4a84-bc5c-7da70f47068d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-e1656a0c-b13f-4d48-b39a-df896592bd4b" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-e1656a0c-b13f-4d48-b39a-df896592bd4b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Deleting offline snapshot e1656a0c-b13f-4d48-b39a-df896592bd4b of volume 53c83eca-e16a-4a84-bc5c-7da70f47068d {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] snapshot_file for this snap is: volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a3a9f6-b298-4af0-9cb9-f59942964f07]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:25:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:00 devstack sudo[115228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b Aug 01 15:26:00 devstack sudo[115228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:00 devstack sudo[115226]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e" returned: 0 in 0.293s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-4b5ec140-2dbf-42dd-9310-b30bcaf43b11 req-a7adb972-79a3-4cb8-a81f-3bb8490dbb09 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.085s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bed9ba-22ff-406b-b64e-da0bc617dded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf83d72-99ec-46aa-92ff-ff204649150e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cff150c-7486-43f7-8fb2-6d90b41030f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-4b5ec140-2dbf-42dd-9310-b30bcaf43b11 req-a7adb972-79a3-4cb8-a81f-3bb8490dbb09 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:00 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Volume volume-3bf83d72-99ec-46aa-92ff-ff204649150e (3bf83d72-99ec-46aa-92ff-ff204649150e): created successfully Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cff150c-7486-43f7-8fb2-6d90b41030f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Flow 'volume_create_manager' (cf77cc97-8cd1-4bed-b8c3-72574a4ddca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-331a6b0d-b4e4-4a38-a694-f0837711ce64 tempest-CinderUnicodeTest-1909134897 None] Created volume successfully. Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-4b5ec140-2dbf-42dd-9310-b30bcaf43b11 req-a7adb972-79a3-4cb8-a81f-3bb8490dbb09 tempest-SnapshotDataIntegrityTests-992674527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-e39f0131-2018-46dc-a3af-2fe4c56f3687', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6c3cdb0-f159-44f1-a65e-9d1e12d65f4c', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:26:00 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-4b5ec140-2dbf-42dd-9310-b30bcaf43b11 req-a7adb972-79a3-4cb8-a81f-3bb8490dbb09 tempest-SnapshotDataIntegrityTests-992674527 None] attachment_update completed successfully. Aug 01 15:26:00 devstack sudo[115228]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b" returned: 0 in 0.429s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53c83eca-e16a-4a84-bc5c-7da70f47068d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf00c84-3850-4f7b-a0eb-e924968d802e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:00 devstack sudo[115257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d Aug 01 15:26:00 devstack sudo[115257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:00 devstack sudo[115257]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d" returned: 0 in 0.378s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:00 devstack sudo[115624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b Aug 01 15:26:00 devstack sudo[115624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:01 devstack sudo[115624]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b" returned: 0 in 0.481s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:01 devstack sudo[115630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b Aug 01 15:26:01 devstack sudo[115630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:01 devstack sudo[115630]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] Creating offline snapshot 23a30db9-105d-4e12-99f1-2a7da591539f of volume 3bf83d72-99ec-46aa-92ff-ff204649150e {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d.e1656a0c-b13f-4d48-b39a-df896592bd4b" returned: 0 in 0.318s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5bfae7-0d72-428b-9f03-dad2570a703e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-e1656a0c-b13f-4d48-b39a-df896592bd4b" released by "_delete_snapshot" :: held 1.726s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-53c83eca-e16a-4a84-bc5c-7da70f47068d" released by "delete_snapshot" :: held 1.756s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Created reservations ['132451f4-7e4a-429e-8175-2e8017050d73', '7ceadd8e-716b-46e0-a4f5-71c8a3f764a4', '57a0b5b9-5bf6-4a22-961c-909791dcc6c7', '5c536e07-ffc6-4d6a-a0e1-d56f6b813e01'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:01 devstack sudo[115633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e Aug 01 15:26:01 devstack sudo[115633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:01 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Delete snapshot completed successfully. Aug 01 15:26:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0d46da8a-ef5e-4487-8fa7-95aa73cd7177 tempest-ProjectMemberTests-660978679 None] Lock "cinder-e1656a0c-b13f-4d48-b39a-df896592bd4b-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:02 devstack sudo[115633]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e" returned: 0 in 0.409s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-53c83eca-e16a-4a84-bc5c-7da70f47068d-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:02 devstack sudo[115641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f 1G Aug 01 15:26:02 devstack sudo[115641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Lock "cinder-53c83eca-e16a-4a84-bc5c-7da70f47068d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-53c83eca-e16a-4a84-bc5c-7da70f47068d" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-53c83eca-e16a-4a84-bc5c-7da70f47068d" acquired by "delete_volume" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6acb6c-852d-49be-939a-458ec7b9bc13]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:02 devstack sudo[115648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d Aug 01 15:26:02 devstack sudo[115648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:02 devstack sudo[115641]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f 1G" returned: 0 in 0.537s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bf83d72-99ec-46aa-92ff-ff204649150e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:02 devstack sudo[115660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bf83d72-99ec-46aa-92ff-ff204649150e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f Aug 01 15:26:02 devstack sudo[115660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:02 devstack sudo[115648]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d" returned: 0 in 0.464s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:02 devstack sudo[115666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d Aug 01 15:26:02 devstack sudo[115666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:02 devstack sudo[115660]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bf83d72-99ec-46aa-92ff-ff204649150e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f" returned: 0 in 0.379s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:02 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f is being set with open permissions: ugo+rw Aug 01 15:26:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:02 devstack sudo[115676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f Aug 01 15:26:02 devstack sudo[115676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:03 devstack sudo[115666]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-53c83eca-e16a-4a84-bc5c-7da70f47068d" returned: 0 in 0.320s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-53c83eca-e16a-4a84-bc5c-7da70f47068d" released by "delete_volume" :: held 0.876s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Created reservations ['70f06abd-12e1-4ece-8069-040da60603e1', '9bd79bed-e6e8-474a-93d1-9f6e60c1a8b9', '904d527f-7b89-4b3a-9758-d1ea11a61973', '48314a21-7ab9-4ae9-b1a3-17fc0d9ae72c'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:03 devstack sudo[115684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:03 devstack sudo[115684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:03 devstack sudo[115676]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f" returned: 0 in 0.344s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:03 devstack sudo[115686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.info Aug 01 15:26:03 devstack sudo[115686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:03 devstack sudo[115684]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.425s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Deleted volume successfully. Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=115,cinder:UPDATE=102,cinder:INSERT=29,cinder:DELETE=6 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-d0b8c3cb-cbd3-4180-8585-55a8f0aa5887 tempest-ProjectMemberTests-660978679 None] Lock "cinder-53c83eca-e16a-4a84-bc5c-7da70f47068d-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:03 devstack sudo[115686]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.info" returned: 0 in 0.577s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:03 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.info is being set with open permissions: ugo+rw Aug 01 15:26:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:03 devstack sudo[115690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.info Aug 01 15:26:03 devstack sudo[115690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (a3a337b9-e2ed-4397-bc4e-82cc01f24106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbba9eb1-8515-4ab8-877f-cfbb19a46087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbba9eb1-8515-4ab8-877f-cfbb19a46087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185049384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c086d8-696b-4f47-805c-63f028928adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:04Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3067c76-05c6-4101-91f4-ed6981c72a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3067c76-05c6-4101-91f4-ed6981c72a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02077d3-dff6-4d04-9f07-63af077208e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02077d3-dff6-4d04-9f07-63af077208e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c086d8-696b-4f47-805c-63f028928adc', 'volume_name': 'volume-d9c086d8-696b-4f47-805c-63f028928adc', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e6ac85-79df-472b-9c86-bd4628a5edd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e6ac85-79df-472b-9c86-bd4628a5edd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a30f3e4-8f9d-4caa-b64d-b07868973912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:04 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Volume d9c086d8-696b-4f47-805c-63f028928adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c086d8-696b-4f47-805c-63f028928adc', 'volume_size': 1} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:04 devstack sudo[115690]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.info" returned: 0 in 0.351s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.741s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.173s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185049384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c086d8-696b-4f47-805c-63f028928adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:04Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Creating volume d9c086d8-696b-4f47-805c-63f028928adc {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:26:04 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-d848cd92-bc4a-47d4-a287-bd2a293ff5ed req-20b9383a-8821-451f-9aa4-6a591c3f3047 tempest-SnapshotDataIntegrityTests-992674527 None] Terminate volume connection completed successfully. Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-d848cd92-bc4a-47d4-a287-bd2a293ff5ed req-20b9383a-8821-451f-9aa4-6a591c3f3047 tempest-SnapshotDataIntegrityTests-992674527 None] Deleting attachment d6c3cdb0-f159-44f1-a65e-9d1e12d65f4c. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:26:04 devstack sudo[115723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc 1073741824 Aug 01 15:26:04 devstack sudo[115723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-907d43bf-a326-4b7a-bf79-623e31cfab36 tempest-CinderUnicodeTest-1909134897 None] Create snapshot completed successfully Aug 01 15:26:04 devstack sudo[115723]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc 1073741824" returned: 0 in 0.520s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "cinder-23a30db9-105d-4e12-99f1-2a7da591539f-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-23a30db9-105d-4e12-99f1-2a7da591539f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "cinder-quobyte-3bf83d72-99ec-46aa-92ff-ff204649150e" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-quobyte-3bf83d72-99ec-46aa-92ff-ff204649150e" acquired by "delete_snapshot" :: waited 0.051s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:04 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "cinder-quobyte-23a30db9-105d-4e12-99f1-2a7da591539f" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:04 devstack sudo[115729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc Aug 01 15:26:04 devstack sudo[115729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-quobyte-23a30db9-105d-4e12-99f1-2a7da591539f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Deleting offline snapshot 23a30db9-105d-4e12-99f1-2a7da591539f of volume 3bf83d72-99ec-46aa-92ff-ff204649150e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] snapshot_file for this snap is: volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e150430-64e1-4339-b6a4-c6438fd7bc79]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:05 devstack sudo[115731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f Aug 01 15:26:05 devstack sudo[115731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:05 devstack sudo[115729]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc" returned: 0 in 0.314s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a30f3e4-8f9d-4caa-b64d-b07868973912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c086d8-696b-4f47-805c-63f028928adc', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc26087-ad54-41aa-bdbb-5e3d5a374732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:05 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Volume volume-d9c086d8-696b-4f47-805c-63f028928adc (d9c086d8-696b-4f47-805c-63f028928adc): created successfully Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc26087-ad54-41aa-bdbb-5e3d5a374732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (a3a337b9-e2ed-4397-bc4e-82cc01f24106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:05 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-cf1b85ee-0c75-463a-8e9f-9ce8bbfef0f0 tempest-ProjectMemberTests-660978679 None] Created volume successfully. Aug 01 15:26:05 devstack sudo[115731]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f" returned: 0 in 0.438s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bf83d72-99ec-46aa-92ff-ff204649150e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[26420255-dca6-4704-a64e-4c98c8206bd4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Flow 'volume_create_manager' (a3110a25-a209-43b0-8795-916ef4492225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef057779-3164-41ce-bba8-4aac975d1e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef057779-3164-41ce-bba8-4aac975d1e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1801156100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a85b8cc-65c4-47f5-a261-4c09f9d1dab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a9664c1f624484b86a04352731e3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cda4bdf3-fa9d-48fb-96fb-3a39e482f832,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:06Z,use_quota=True,user_id='74ce19bc1ce44396b6596da7499917d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b41c13b-01e9-4203-9d15-c583ed617059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b41c13b-01e9-4203-9d15-c583ed617059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:05 devstack sudo[115737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e Aug 01 15:26:05 devstack sudo[115737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66566aac-6b14-4258-af76-4d68139d4ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66566aac-6b14-4258-af76-4d68139d4ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a85b8cc-65c4-47f5-a261-4c09f9d1dab5', 'volume_name': 'volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5', 'volume_size': 1, 'snapshot_id': 'cda4bdf3-fa9d-48fb-96fb-3a39e482f832'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0fdb94-1eef-4873-b224-cf72546e2b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0fdb94-1eef-4873-b224-cf72546e2b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3827c7-392e-4d1e-9198-dc3cc3756745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:05 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Volume 8a85b8cc-65c4-47f5-a261-4c09f9d1dab5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5', 'volume_size': 1, 'snapshot_id': 'cda4bdf3-fa9d-48fb-96fb-3a39e482f832'} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-cda4bdf3-fa9d-48fb-96fb-3a39e482f832-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-cda4bdf3-fa9d-48fb-96fb-3a39e482f832-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Creating volume 8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 from snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] snapshot: cda4bdf3-fa9d-48fb-96fb-3a39e482f832, volume: 8a85b8cc-65c4-47f5-a261-4c09f9d1dab5, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f1b8c1-3f6a-4cd3-bc20-2dd9c0565ebe]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:05 devstack sudo[115739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 Aug 01 15:26:05 devstack sudo[115739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:05 devstack sudo[115737]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e" returned: 0 in 0.409s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:05 devstack sudo[115744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f Aug 01 15:26:05 devstack sudo[115744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:06 devstack sudo[115739]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832" returned: 0 in 0.430s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6937670f-f0bf-4b91-bdfd-e1bcae3c3edb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:06 devstack sudo[115744]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f" returned: 0 in 0.451s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:06 devstack sudo[115753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 Aug 01 15:26:06 devstack sudo[115753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:06 devstack sudo[115755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f Aug 01 15:26:06 devstack sudo[115755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:06 devstack sudo[115755]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e.23a30db9-105d-4e12-99f1-2a7da591539f" returned: 0 in 0.263s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:06 devstack sudo[115753]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50" returned: 0 in 0.433s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-quobyte-23a30db9-105d-4e12-99f1-2a7da591539f" released by "_delete_snapshot" :: held 1.699s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-quobyte-3bf83d72-99ec-46aa-92ff-ff204649150e" released by "delete_snapshot" :: held 1.761s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:06 devstack sudo[115762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 Aug 01 15:26:06 devstack sudo[115762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Created reservations ['1f5ebe8a-280e-4b71-ab3d-c2745e27d2b5', '731ebcab-0d61-417b-aa40-891f6ffd4e4a', '0ee50c3b-947c-4491-8f10-db195f8f1ff4', 'd8a5e6a6-2422-40ab-b541-c057e26cd9ff'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:06 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Delete snapshot completed successfully. Aug 01 15:26:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ec427fc7-b547-4a7d-81c9-68cab4ae124b tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-23a30db9-105d-4e12-99f1-2a7da591539f-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "cinder-3bf83d72-99ec-46aa-92ff-ff204649150e-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-3bf83d72-99ec-46aa-92ff-ff204649150e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "cinder-quobyte-3bf83d72-99ec-46aa-92ff-ff204649150e" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-quobyte-3bf83d72-99ec-46aa-92ff-ff204649150e" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[41221471-0733-45fd-86a8-ae25f37c5ae6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:07 devstack sudo[115767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e Aug 01 15:26:07 devstack sudo[115767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:07 devstack sudo[115767]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e" returned: 0 in 0.476s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:07 devstack sudo[115779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e Aug 01 15:26:07 devstack sudo[115779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:08 devstack sudo[115779]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-3bf83d72-99ec-46aa-92ff-ff204649150e" returned: 0 in 0.680s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-quobyte-3bf83d72-99ec-46aa-92ff-ff204649150e" released by "delete_volume" :: held 1.265s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:08 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Created reservations ['ffb17fa2-d47a-4d8a-bf26-3d27ef8ac878', '8d716291-1f6f-4495-8984-694f53405792', '7a4273b6-f1bd-43df-b747-3d03de5ba058', 'bd667e44-bee5-4bd3-9d8d-30f486a60476'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:09 devstack sudo[115782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:09 devstack sudo[115782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "cinder-c0f3ce4a-227a-44b8-8cde-9c635927bd1e-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-c0f3ce4a-227a-44b8-8cde-9c635927bd1e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:09 devstack sudo[115782]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 1.003s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:09 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Deleted volume successfully. Aug 01 15:26:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "cinder-quobyte-c0f3ce4a-227a-44b8-8cde-9c635927bd1e" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-quobyte-c0f3ce4a-227a-44b8-8cde-9c635927bd1e" acquired by "delete_volume" :: waited 0.043s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-682063f4-0845-45b0-890d-4cdb1c26010a tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-3bf83d72-99ec-46aa-92ff-ff204649150e-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:10 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ff9ce2-90f6-4b11-bf96-b811ebc77437]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:10 devstack sudo[115790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e Aug 01 15:26:10 devstack sudo[115790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:11 devstack sudo[115790]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e" returned: 0 in 0.943s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:11 devstack sudo[115801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e Aug 01 15:26:11 devstack sudo[115801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:11 devstack sudo[115801]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c0f3ce4a-227a-44b8-8cde-9c635927bd1e" returned: 0 in 0.629s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-quobyte-c0f3ce4a-227a-44b8-8cde-9c635927bd1e" released by "delete_volume" :: held 1.687s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:11 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Created reservations ['c7c0f838-9818-4000-bbc0-2a871ebb4383', '1164437c-b83e-498f-8c00-49be81b6ef51', 'b39a518e-e13b-4a46-a0a5-e3a6a0880c0c', 'b159fc20-0ca0-4512-be03-c07013086925'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:12 devstack sudo[115804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:12 devstack sudo[115804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:12 devstack sudo[115804]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.590s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:12 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Deleted volume successfully. Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" returned: 0 in 5.986s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:26:12 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Converted 1024.00 MB image at 170.98 MB/s Aug 01 15:26:12 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 is being set with open permissions: ugo+rw Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1a9e4aae-4b66-4700-aab8-3b4a8e158237 tempest-CinderUnicodeTest-1909134897 None] Lock "cinder-c0f3ce4a-227a-44b8-8cde-9c635927bd1e-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:12 devstack sudo[115807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 Aug 01 15:26:12 devstack sudo[115807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:12 devstack sudo[115807]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" returned: 0 in 0.285s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:12 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" released by "_copy_volume_from_snapshot" :: held 7.244s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-cda4bdf3-fa9d-48fb-96fb-3a39e482f832-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" released by "_create_volume_from_snapshot" :: held 7.326s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.345s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.732s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] Creating offline snapshot 63cb52bf-9fb9-4412-9a72-705cd7c30d1c of volume d9c086d8-696b-4f47-805c-63f028928adc {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3827c7-392e-4d1e-9198-dc3cc3756745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5', 'volume_size': 1, 'snapshot_id': 'cda4bdf3-fa9d-48fb-96fb-3a39e482f832'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d83a0fd-9ec0-4515-b824-fa0149a1e47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58dc186-1287-4403-8fc3-218e54bf4543]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:13 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Volume volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 (8a85b8cc-65c4-47f5-a261-4c09f9d1dab5): created successfully Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d83a0fd-9ec0-4515-b824-fa0149a1e47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Flow 'volume_create_manager' (a3110a25-a209-43b0-8795-916ef4492225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:13 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0ab2ebfc-c399-4ba3-8f45-382473444367 tempest-SnapshotDataIntegrityTests-992674527 None] Created volume successfully. Aug 01 15:26:13 devstack sudo[115810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc Aug 01 15:26:13 devstack sudo[115810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:13 devstack sudo[115810]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc" returned: 0 in 0.498s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:13 devstack sudo[115819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c 1G Aug 01 15:26:13 devstack sudo[115819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:14 devstack sudo[115819]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c 1G" returned: 0 in 0.554s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c086d8-696b-4f47-805c-63f028928adc -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:14 devstack sudo[115828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c086d8-696b-4f47-805c-63f028928adc -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c Aug 01 15:26:14 devstack sudo[115828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:14 devstack sudo[115828]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9c086d8-696b-4f47-805c-63f028928adc -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c" returned: 0 in 0.394s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:14 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c is being set with open permissions: ugo+rw Aug 01 15:26:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-0e0f19b1-70a1-4a98-86f2-b8486a0ccdfc req-3c7207a9-7056-4698-8e91-ab58b73fba76 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:14 devstack sudo[115841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c Aug 01 15:26:14 devstack sudo[115841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:14 devstack sudo[115841]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c" returned: 0 in 0.326s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:14 devstack sudo[115844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.info Aug 01 15:26:14 devstack sudo[115844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:15 devstack sudo[115844]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.info" returned: 0 in 0.289s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:15 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.info is being set with open permissions: ugo+rw Aug 01 15:26:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:15 devstack sudo[115847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.info Aug 01 15:26:15 devstack sudo[115847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:15 devstack sudo[115847]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.info" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-0e0f19b1-70a1-4a98-86f2-b8486a0ccdfc req-3c7207a9-7056-4698-8e91-ab58b73fba76 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.931s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-0e0f19b1-70a1-4a98-86f2-b8486a0ccdfc req-3c7207a9-7056-4698-8e91-ab58b73fba76 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b27f8eb5-549a-46e4-9a46-244a883f4b9e tempest-ProjectMemberTests-660978679 None] Create snapshot completed successfully Aug 01 15:26:15 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-0e0f19b1-70a1-4a98-86f2-b8486a0ccdfc req-3c7207a9-7056-4698-8e91-ab58b73fba76 tempest-SnapshotDataIntegrityTests-992674527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60681a9a-294d-4f15-b252-bbfcc405270e', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:26:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-0e0f19b1-70a1-4a98-86f2-b8486a0ccdfc req-3c7207a9-7056-4698-8e91-ab58b73fba76 tempest-SnapshotDataIntegrityTests-992674527 None] attachment_update completed successfully. Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-63cb52bf-9fb9-4412-9a72-705cd7c30d1c-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Lock "cinder-63cb52bf-9fb9-4412-9a72-705cd7c30d1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-d9c086d8-696b-4f47-805c-63f028928adc" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-d9c086d8-696b-4f47-805c-63f028928adc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-63cb52bf-9fb9-4412-9a72-705cd7c30d1c" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-63cb52bf-9fb9-4412-9a72-705cd7c30d1c" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Deleting offline snapshot 63cb52bf-9fb9-4412-9a72-705cd7c30d1c of volume d9c086d8-696b-4f47-805c-63f028928adc {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] snapshot_file for this snap is: volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2489c242-c3db-49d7-a72e-2f7b426388cb]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:16 devstack sudo[116235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c Aug 01 15:26:16 devstack sudo[116235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:16 devstack sudo[116235]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c" returned: 0 in 0.477s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9c086d8-696b-4f47-805c-63f028928adc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0badf637-6051-4719-b947-3ea7cebf5cc5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:16 devstack sudo[116241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc Aug 01 15:26:16 devstack sudo[116241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:17 devstack sudo[116241]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc" returned: 0 in 0.473s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:17 devstack sudo[116246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c Aug 01 15:26:17 devstack sudo[116246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (7994a606-abbd-40e5-9f3f-5a0bcd1a8e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a93330-86b3-467d-adac-47b8fa1483e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a93330-86b3-467d-adac-47b8fa1483e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853022675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bca2206-3897-41d0-bb3b-4b350354b5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:17Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166e7aeb-d334-4233-b923-cca82b12a9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166e7aeb-d334-4233-b923-cca82b12a9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56dd79c4-43a9-4d92-b3ff-6cbc9e34a254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56dd79c4-43a9-4d92-b3ff-6cbc9e34a254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bca2206-3897-41d0-bb3b-4b350354b5c0', 'volume_name': 'volume-1bca2206-3897-41d0-bb3b-4b350354b5c0', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b6ddec-a0db-47f6-835a-5c4a76125377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b6ddec-a0db-47f6-835a-5c4a76125377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2af371-8393-4dce-a266-24945149093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:17 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Volume 1bca2206-3897-41d0-bb3b-4b350354b5c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bca2206-3897-41d0-bb3b-4b350354b5c0', 'volume_size': 1} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853022675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bca2206-3897-41d0-bb3b-4b350354b5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:17Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Creating volume 1bca2206-3897-41d0-bb3b-4b350354b5c0 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:26:17 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:17 devstack sudo[116249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 1073741824 Aug 01 15:26:17 devstack sudo[116249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:17 devstack sudo[116246]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c" returned: 0 in 0.419s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:17 devstack sudo[116257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c Aug 01 15:26:17 devstack sudo[116257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:17 devstack sudo[116257]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc.63cb52bf-9fb9-4412-9a72-705cd7c30d1c" returned: 0 in 0.320s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-63cb52bf-9fb9-4412-9a72-705cd7c30d1c" released by "_delete_snapshot" :: held 1.824s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-d9c086d8-696b-4f47-805c-63f028928adc" released by "delete_snapshot" :: held 1.887s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:17 devstack sudo[116249]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 1073741824" returned: 0 in 0.579s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:18 devstack sudo[116272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 Aug 01 15:26:18 devstack sudo[116272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Created reservations ['469af91a-f9e1-404d-ab0f-4b4746f088de', 'ebcf1964-83f7-4653-ac14-333f174683ed', 'a5b47855-85c1-40eb-8454-3ed2ccaf851d', '4d927c33-1105-4b95-9bf2-b7085d905378'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Delete snapshot completed successfully. Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-4a564205-2a51-4cbd-a50d-31a18aa6e3ef tempest-ProjectMemberTests-660978679 None] Lock "cinder-63cb52bf-9fb9-4412-9a72-705cd7c30d1c-delete_snapshot" released by "delete_snapshot" :: held 2.108s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-d9c086d8-696b-4f47-805c-63f028928adc-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Lock "cinder-d9c086d8-696b-4f47-805c-63f028928adc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-d9c086d8-696b-4f47-805c-63f028928adc" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-d9c086d8-696b-4f47-805c-63f028928adc" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:18 devstack sudo[116272]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0" returned: 0 in 0.401s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2af371-8393-4dce-a266-24945149093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bca2206-3897-41d0-bb3b-4b350354b5c0', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6e677c-ec0b-4e0e-8fb8-2740712bf0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b085d31-54a9-4b09-b7b7-e49cffa43820]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:18 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Volume volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 (1bca2206-3897-41d0-bb3b-4b350354b5c0): created successfully Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6e677c-ec0b-4e0e-8fb8-2740712bf0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (7994a606-abbd-40e5-9f3f-5a0bcd1a8e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-05691a3c-aed0-408f-87ee-20b15d095bbd tempest-ProjectReaderTests-1876340520 None] Created volume successfully. Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:18 devstack sudo[116286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:18 devstack sudo[116286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:18 devstack sudo[116281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc Aug 01 15:26:18 devstack sudo[116281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:18 devstack sudo[116286]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.326s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:26:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:26:18 devstack sudo[116281]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc" returned: 0 in 0.519s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:19 devstack sudo[116293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc Aug 01 15:26:19 devstack sudo[116293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:19 devstack sudo[116293]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d9c086d8-696b-4f47-805c-63f028928adc" returned: 0 in 0.280s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-d9c086d8-696b-4f47-805c-63f028928adc" released by "delete_volume" :: held 0.893s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Created reservations ['842ea241-f9c8-47e0-ad2f-fb441b0569f1', '74f68da6-9f0d-4a46-8bc3-8ea929bd18f0', 'bd9c06b8-f01b-4509-86cb-c0d424b186fa', '37eb34ad-be56-422b-aff5-63cf8edd12cd'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:19 devstack sudo[116299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:19 devstack sudo[116299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] Creating offline snapshot 4ac8d601-f296-4761-9a4b-5be665674dbf of volume 1bca2206-3897-41d0-bb3b-4b350354b5c0 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[73675f6c-2f12-49b8-b637-a39ff3b5b19c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:19 devstack sudo[116299]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Deleted volume successfully. Aug 01 15:26:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-01c38deb-1f45-4383-b0de-1c82baef0f5a tempest-ProjectMemberTests-660978679 None] Lock "cinder-d9c086d8-696b-4f47-805c-63f028928adc-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:19 devstack sudo[116329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 Aug 01 15:26:19 devstack sudo[116329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:20 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-7b1317d3-bc60-4f0f-8217-67c5b6fb4083 req-1678214b-5443-42d2-9cf7-0d0045ba9526 tempest-SnapshotDataIntegrityTests-992674527 None] Terminate volume connection completed successfully. Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-7b1317d3-bc60-4f0f-8217-67c5b6fb4083 req-1678214b-5443-42d2-9cf7-0d0045ba9526 tempest-SnapshotDataIntegrityTests-992674527 None] Deleting attachment 60681a9a-294d-4f15-b252-bbfcc405270e. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:26:20 devstack sudo[116329]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0" returned: 0 in 0.511s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:20 devstack sudo[116335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf 1G Aug 01 15:26:20 devstack sudo[116335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (e2340f91-2e56-4734-ba11-ecfedd020fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a46b32-749d-492b-bc9c-4fd61250f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a46b32-749d-492b-bc9c-4fd61250f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522652713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48d0501-cf6a-4278-858b-974c3427b5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:20Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f76079-b3a8-4883-b5bb-cd88af7f0511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f76079-b3a8-4883-b5bb-cd88af7f0511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8129fc82-147c-49e8-8c86-8d169685a891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8129fc82-147c-49e8-8c86-8d169685a891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a48d0501-cf6a-4278-858b-974c3427b5e4', 'volume_name': 'volume-a48d0501-cf6a-4278-858b-974c3427b5e4', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6b8440-89a6-4d08-a4fd-9b42d24a3f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6b8440-89a6-4d08-a4fd-9b42d24a3f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c218080c-e5ad-4d29-95a8-c0351f1007e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:20 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Volume a48d0501-cf6a-4278-858b-974c3427b5e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a48d0501-cf6a-4278-858b-974c3427b5e4', 'volume_size': 1} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:20 devstack sudo[116335]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf 1G" returned: 0 in 0.417s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:20 devstack sudo[116340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf Aug 01 15:26:20 devstack sudo[116340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:21 devstack sudo[116340]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf" returned: 0 in 0.297s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:21 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf is being set with open permissions: ugo+rw Aug 01 15:26:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:21 devstack sudo[116345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf Aug 01 15:26:21 devstack sudo[116345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:21 devstack sudo[116345]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf" returned: 0 in 0.268s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:21 devstack sudo[116348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.info Aug 01 15:26:21 devstack sudo[116348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:21 devstack sudo[116348]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.info" returned: 0 in 0.283s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:21 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.info is being set with open permissions: ugo+rw Aug 01 15:26:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:21 devstack sudo[116351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.info Aug 01 15:26:21 devstack sudo[116351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:21 devstack sudo[116351]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.info" returned: 0 in 0.358s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.401s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522652713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48d0501-cf6a-4278-858b-974c3427b5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:20Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Creating volume a48d0501-cf6a-4278-858b-974c3427b5e4 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:26:22 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:22 devstack sudo[116388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 1073741824 Aug 01 15:26:22 devstack sudo[116388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:26:22 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e0cc0080-5a14-4dce-9371-d9c735cc9197 tempest-ProjectReaderTests-1876340520 None] Create snapshot completed successfully Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Flow 'volume_create_manager' (db07efcd-901d-441f-8f24-499631f2bf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03aaee48-9759-4eb6-a40e-ffb3f8c37716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03aaee48-9759-4eb6-a40e-ffb3f8c37716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-333165440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b0290ca-047b-48a8-897c-f0bb2df71acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a9664c1f624484b86a04352731e3f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4257430-12a7-449c-b348-2ea91037d7bb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:22Z,use_quota=True,user_id='74ce19bc1ce44396b6596da7499917d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ccd7b6-4a0c-4475-965e-68c37c762db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ccd7b6-4a0c-4475-965e-68c37c762db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bac986-31f9-4bb1-9fa8-8421271a2f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bac986-31f9-4bb1-9fa8-8421271a2f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b0290ca-047b-48a8-897c-f0bb2df71acf', 'volume_name': 'volume-2b0290ca-047b-48a8-897c-f0bb2df71acf', 'volume_size': 1, 'snapshot_id': 'a4257430-12a7-449c-b348-2ea91037d7bb'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8569b823-887e-4d43-a721-f322ca37b9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8569b823-887e-4d43-a721-f322ca37b9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f33515-8508-4050-92c4-588b5b15bf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:22 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Volume 2b0290ca-047b-48a8-897c-f0bb2df71acf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b0290ca-047b-48a8-897c-f0bb2df71acf', 'volume_size': 1, 'snapshot_id': 'a4257430-12a7-449c-b348-2ea91037d7bb'} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:22 devstack sudo[116388]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 1073741824" returned: 0 in 0.582s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:22 devstack sudo[116396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 Aug 01 15:26:22 devstack sudo[116396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:22 devstack sudo[116396]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4" returned: 0 in 0.250s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.609s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-a4257430-12a7-449c-b348-2ea91037d7bb-2b0290ca-047b-48a8-897c-f0bb2df71acf" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c218080c-e5ad-4d29-95a8-c0351f1007e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48d0501-cf6a-4278-858b-974c3427b5e4', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970cb44d-914a-4863-a252-8d028dfd8ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-a4257430-12a7-449c-b348-2ea91037d7bb-2b0290ca-047b-48a8-897c-f0bb2df71acf" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Creating volume 2b0290ca-047b-48a8-897c-f0bb2df71acf from snapshot a4257430-12a7-449c-b348-2ea91037d7bb {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-2b0290ca-047b-48a8-897c-f0bb2df71acf" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:22 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Volume volume-a48d0501-cf6a-4278-858b-974c3427b5e4 (a48d0501-cf6a-4278-858b-974c3427b5e4): created successfully Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970cb44d-914a-4863-a252-8d028dfd8ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (e2340f91-2e56-4734-ba11-ecfedd020fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-2b0290ca-047b-48a8-897c-f0bb2df71acf" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] snapshot: a4257430-12a7-449c-b348-2ea91037d7bb, volume: 2b0290ca-047b-48a8-897c-f0bb2df71acf, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:26:22 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6d15e032-4d70-4099-b86b-18fdb6d72f56 tempest-ProjectMemberTests-660978679 None] Created volume successfully. Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[879d9bca-6bbf-40fc-8275-36d406c3e6cc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:23 devstack sudo[116399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb Aug 01 15:26:23 devstack sudo[116399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-4ac8d601-f296-4761-9a4b-5be665674dbf-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-4ac8d601-f296-4761-9a4b-5be665674dbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-1bca2206-3897-41d0-bb3b-4b350354b5c0" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-1bca2206-3897-41d0-bb3b-4b350354b5c0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-4ac8d601-f296-4761-9a4b-5be665674dbf" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:23 devstack sudo[116399]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb" returned: 0 in 0.433s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-4ac8d601-f296-4761-9a4b-5be665674dbf" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Deleting offline snapshot 4ac8d601-f296-4761-9a4b-5be665674dbf of volume 1bca2206-3897-41d0-bb3b-4b350354b5c0 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] snapshot_file for this snap is: volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5158270c-c017-48e6-afcb-9771e33546f7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ef3274-7a0b-449b-b4c2-1d978deb677f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:23 devstack sudo[116410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 Aug 01 15:26:23 devstack sudo[116410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:23 devstack sudo[116411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf Aug 01 15:26:23 devstack sudo[116411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:23 devstack sudo[116410]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832" returned: 0 in 0.446s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:23 devstack sudo[116420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf Aug 01 15:26:23 devstack sudo[116420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:23 devstack sudo[116411]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf" returned: 0 in 0.478s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bca2206-3897-41d0-bb3b-4b350354b5c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa37359-3409-4882-a745-0d950e4476a5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:24 devstack sudo[116422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 Aug 01 15:26:24 devstack sudo[116422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:24 devstack sudo[116422]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0" returned: 0 in 0.386s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:24 devstack sudo[116430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf Aug 01 15:26:24 devstack sudo[116430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:24 devstack sudo[116430]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf" returned: 0 in 0.502s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:25 devstack sudo[116440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf Aug 01 15:26:25 devstack sudo[116440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:25 devstack sudo[116440]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0.4ac8d601-f296-4761-9a4b-5be665674dbf" returned: 0 in 0.773s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-4ac8d601-f296-4761-9a4b-5be665674dbf" released by "_delete_snapshot" :: held 2.329s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-1bca2206-3897-41d0-bb3b-4b350354b5c0" released by "delete_snapshot" :: held 2.376s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:26 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Created reservations ['60f4f42f-9d08-4cb0-89dd-9f93878e3cee', '3b15e16c-8254-4cfe-b424-803ba7689748', '6146a397-b420-44f9-a21d-9b00c0a1a713', '4da7ccd5-e8c9-4e41-8fb8-384306aead5d'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:26 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Delete snapshot completed successfully. Aug 01 15:26:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a4e1bef5-85c4-4507-b3a8-f32bcde75548 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-4ac8d601-f296-4761-9a4b-5be665674dbf-delete_snapshot" released by "delete_snapshot" :: held 2.851s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-1bca2206-3897-41d0-bb3b-4b350354b5c0-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-1bca2206-3897-41d0-bb3b-4b350354b5c0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-1bca2206-3897-41d0-bb3b-4b350354b5c0" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:26 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-1bca2206-3897-41d0-bb3b-4b350354b5c0" acquired by "delete_volume" :: waited 0.040s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:27 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6dccd5-605d-4091-be54-06a0f4e0ce3b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:27 devstack sudo[116446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 Aug 01 15:26:27 devstack sudo[116446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:27 devstack sudo[116446]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0" returned: 0 in 0.750s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:27 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:27 devstack sudo[116451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0 Aug 01 15:26:27 devstack sudo[116451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:28 devstack sudo[116451]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1bca2206-3897-41d0-bb3b-4b350354b5c0" returned: 0 in 0.428s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:28 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-1bca2206-3897-41d0-bb3b-4b350354b5c0" released by "delete_volume" :: held 1.328s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:28 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Created reservations ['c663523f-5871-46bc-b215-b6fc3a18fc56', 'd66967bc-23a5-47dd-85b3-9c1aea94195f', 'f0602d8c-7e77-4ef6-8456-0c2493bf8b83', '2c0028ef-9f86-420e-b4ae-aaac88844465'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:28 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:28 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:28 devstack sudo[116454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:28 devstack sudo[116454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:29 devstack sudo[116454]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.723s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:29 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Deleted volume successfully. Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0613e2f4-0c0c-4c78-94a8-2049fee70192 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-1bca2206-3897-41d0-bb3b-4b350354b5c0-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:29 devstack sudo[116420]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf" returned: 0 in 5.666s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:26:29 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Converted 1024.00 MB image at 180.70 MB/s Aug 01 15:26:29 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf is being set with open permissions: ugo+rw Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:29 devstack sudo[116459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf Aug 01 15:26:29 devstack sudo[116459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:29 devstack sudo[116459]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf" returned: 0 in 0.271s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-2b0290ca-047b-48a8-897c-f0bb2df71acf" released by "_copy_volume_from_snapshot" :: held 6.923s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-a4257430-12a7-449c-b348-2ea91037d7bb-2b0290ca-047b-48a8-897c-f0bb2df71acf" released by "_create_volume_from_snapshot" :: held 6.997s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.026s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.189s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] Creating offline snapshot 72202fe7-2184-4719-800b-5a9a91ecca73 of volume a48d0501-cf6a-4278-858b-974c3427b5e4 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f33515-8508-4050-92c4-588b5b15bf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b0290ca-047b-48a8-897c-f0bb2df71acf', 'volume_size': 1, 'snapshot_id': 'a4257430-12a7-449c-b348-2ea91037d7bb'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356ff233-f99e-4d81-94be-3fda95334213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e366d62-a60f-4ae3-9178-91bc92abb1e4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:29 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Volume volume-2b0290ca-047b-48a8-897c-f0bb2df71acf (2b0290ca-047b-48a8-897c-f0bb2df71acf): created successfully Aug 01 15:26:29 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356ff233-f99e-4d81-94be-3fda95334213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Flow 'volume_create_manager' (db07efcd-901d-441f-8f24-499631f2bf27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (6a0e8db7-bc38-477a-8e9d-94ec12bc8248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c955ec-fc67-437f-a5ce-596ea7575dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:30 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-177831dd-4a26-4783-9a60-d0cc872172af tempest-SnapshotDataIntegrityTests-992674527 None] Created volume successfully. Aug 01 15:26:30 devstack sudo[116462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 Aug 01 15:26:30 devstack sudo[116462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c955ec-fc67-437f-a5ce-596ea7575dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842736826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559c3fe6-bf95-4187-9645-1801aaa91c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:30Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad701ef7-8783-47ed-8aff-269ed6e4850c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad701ef7-8783-47ed-8aff-269ed6e4850c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a974b701-4b04-412e-9f78-3b8643ad6842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a974b701-4b04-412e-9f78-3b8643ad6842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '559c3fe6-bf95-4187-9645-1801aaa91c03', 'volume_name': 'volume-559c3fe6-bf95-4187-9645-1801aaa91c03', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0aa1d0-4140-40db-ad75-82c0359ec107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0aa1d0-4140-40db-ad75-82c0359ec107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22649d88-5933-493d-b398-a58b7dd33dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:30 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Volume 559c3fe6-bf95-4187-9645-1801aaa91c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-559c3fe6-bf95-4187-9645-1801aaa91c03', 'volume_size': 1} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:30 devstack sudo[116462]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4" returned: 0 in 0.392s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:30 devstack sudo[116468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 1G Aug 01 15:26:30 devstack sudo[116468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:30 devstack sudo[116468]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 1G" returned: 0 in 0.424s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:30 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48d0501-cf6a-4278-858b-974c3427b5e4 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:30 devstack sudo[116473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48d0501-cf6a-4278-858b-974c3427b5e4 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 Aug 01 15:26:30 devstack sudo[116473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:31 devstack sudo[116473]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a48d0501-cf6a-4278-858b-974c3427b5e4 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73" returned: 0 in 0.312s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:31 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 is being set with open permissions: ugo+rw Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:31 devstack sudo[116482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 Aug 01 15:26:31 devstack sudo[116482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:31 devstack sudo[116482]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73" returned: 0 in 0.274s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:31 devstack sudo[116488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.info Aug 01 15:26:31 devstack sudo[116488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:31 devstack sudo[116488]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.info" returned: 0 in 0.282s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:31 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.info is being set with open permissions: ugo+rw Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:31 devstack sudo[116499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.info Aug 01 15:26:31 devstack sudo[116499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-3916c82c-e268-4c22-a5bb-57bafb1fff2e req-b417f1bc-ea4e-44e5-9512-47fe002c5ec7 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:31 devstack sudo[116499]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.info" returned: 0 in 0.253s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.836s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842736826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559c3fe6-bf95-4187-9645-1801aaa91c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:30Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Creating volume 559c3fe6-bf95-4187-9645-1801aaa91c03 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:26:31 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:26:31 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:31 devstack sudo[116502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 1073741824 Aug 01 15:26:31 devstack sudo[116502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:32 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2adf4d90-e984-43ab-8d91-66a9e6067397 tempest-ProjectMemberTests-660978679 None] Create snapshot completed successfully Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-72202fe7-2184-4719-800b-5a9a91ecca73-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Lock "cinder-72202fe7-2184-4719-800b-5a9a91ecca73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-a48d0501-cf6a-4278-858b-974c3427b5e4" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-a48d0501-cf6a-4278-858b-974c3427b5e4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-72202fe7-2184-4719-800b-5a9a91ecca73" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-72202fe7-2184-4719-800b-5a9a91ecca73" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Deleting offline snapshot 72202fe7-2184-4719-800b-5a9a91ecca73 of volume a48d0501-cf6a-4278-858b-974c3427b5e4 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] snapshot_file for this snap is: volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fb2c39-ee96-4400-8bab-8ea5d68145fd]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:32 devstack sudo[116502]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 1073741824" returned: 0 in 0.461s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:32 devstack sudo[116508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 Aug 01 15:26:32 devstack sudo[116508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:32 devstack sudo[116509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 Aug 01 15:26:32 devstack sudo[116509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:32 devstack sudo[116509]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03" returned: 0 in 0.258s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-3916c82c-e268-4c22-a5bb-57bafb1fff2e req-b417f1bc-ea4e-44e5-9512-47fe002c5ec7 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.978s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [req-3916c82c-e268-4c22-a5bb-57bafb1fff2e req-b417f1bc-ea4e-44e5-9512-47fe002c5ec7 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22649d88-5933-493d-b398-a58b7dd33dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-559c3fe6-bf95-4187-9645-1801aaa91c03', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac89137a-ce07-412b-a8f0-2306a1a6d256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:32 devstack sudo[116508]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73" returned: 0 in 0.414s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a48d0501-cf6a-4278-858b-974c3427b5e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:32 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Volume volume-559c3fe6-bf95-4187-9645-1801aaa91c03 (559c3fe6-bf95-4187-9645-1801aaa91c03): created successfully Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac89137a-ce07-412b-a8f0-2306a1a6d256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (6a0e8db7-bc38-477a-8e9d-94ec12bc8248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a24b90e-2b9c-4217-9eaf-e6f6685cac20]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:32 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-79e68d05-2d39-4731-a0e4-2564dc42bc66 tempest-ProjectReaderTests-1876340520 None] Created volume successfully. Aug 01 15:26:32 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-3916c82c-e268-4c22-a5bb-57bafb1fff2e req-b417f1bc-ea4e-44e5-9512-47fe002c5ec7 tempest-SnapshotDataIntegrityTests-992674527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133', 'name': 'volume-2b0290ca-047b-48a8-897c-f0bb2df71acf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05129cab-e4c8-4cac-a1ec-b5a014d53b47', 'enforce_multipath': True} {{(pid=89024) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 01 15:26:32 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-3916c82c-e268-4c22-a5bb-57bafb1fff2e req-b417f1bc-ea4e-44e5-9512-47fe002c5ec7 tempest-SnapshotDataIntegrityTests-992674527 None] attachment_update completed successfully. Aug 01 15:26:32 devstack sudo[116516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 Aug 01 15:26:32 devstack sudo[116516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:33 devstack sudo[116516]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4" returned: 0 in 0.425s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:33 devstack sudo[116792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 Aug 01 15:26:33 devstack sudo[116792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:33 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] Creating offline snapshot 09a309ec-3ecf-49f6-880c-3edeba192ac1 of volume 559c3fe6-bf95-4187-9645-1801aaa91c03 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:26:33 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e75ca0e-9d62-4cb9-a5af-8f8b9dbc9546]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:33 devstack sudo[116908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 Aug 01 15:26:33 devstack sudo[116908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:33 devstack sudo[116792]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73" returned: 0 in 0.455s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:33 devstack sudo[116915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73 Aug 01 15:26:33 devstack sudo[116915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:33 devstack sudo[116908]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03" returned: 0 in 0.434s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:33 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:33 devstack sudo[116920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 1G Aug 01 15:26:33 devstack sudo[116920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:34 devstack sudo[116915]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4.72202fe7-2184-4719-800b-5a9a91ecca73" returned: 0 in 0.313s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-72202fe7-2184-4719-800b-5a9a91ecca73" released by "_delete_snapshot" :: held 1.721s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-a48d0501-cf6a-4278-858b-974c3427b5e4" released by "delete_snapshot" :: held 1.744s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Created reservations ['6ee5635f-5ff2-451c-9dfc-667bd734448e', '2f813efb-2422-412a-a43e-cf80eb11cafb', '61ef1c9f-fedd-44fe-bdf5-f3c85b5796e0', '89e3501f-c10b-4d88-b361-c609ec76de24'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:34 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Delete snapshot completed successfully. Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7f87bbbe-6f46-4b40-9488-8849da0c7c31 tempest-ProjectMemberTests-660978679 None] Lock "cinder-72202fe7-2184-4719-800b-5a9a91ecca73-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:34 devstack sudo[116920]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 1G" returned: 0 in 0.438s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-559c3fe6-bf95-4187-9645-1801aaa91c03 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:34 devstack sudo[116927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-559c3fe6-bf95-4187-9645-1801aaa91c03 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 Aug 01 15:26:34 devstack sudo[116927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-a48d0501-cf6a-4278-858b-974c3427b5e4-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Lock "cinder-a48d0501-cf6a-4278-858b-974c3427b5e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-a48d0501-cf6a-4278-858b-974c3427b5e4" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-a48d0501-cf6a-4278-858b-974c3427b5e4" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[7848e7dd-8e35-4fd6-8c7d-5fc18e498180]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:34 devstack sudo[116927]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-559c3fe6-bf95-4187-9645-1801aaa91c03 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1" returned: 0 in 0.320s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:34 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 is being set with open permissions: ugo+rw Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:34 devstack sudo[116934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 Aug 01 15:26:34 devstack sudo[116934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:34 devstack sudo[116933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 Aug 01 15:26:34 devstack sudo[116933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:34 devstack sudo[116934]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1" returned: 0 in 0.273s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:34 devstack sudo[116947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.info Aug 01 15:26:34 devstack sudo[116947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:34 devstack sudo[116933]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4" returned: 0 in 0.371s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:34 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:34 devstack sudo[116951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4 Aug 01 15:26:34 devstack sudo[116951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:35 devstack sudo[116947]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.info" returned: 0 in 0.286s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:35 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.info is being set with open permissions: ugo+rw Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:35 devstack sudo[116959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.info Aug 01 15:26:35 devstack sudo[116959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:35 devstack sudo[116951]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-a48d0501-cf6a-4278-858b-974c3427b5e4" returned: 0 in 0.275s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-a48d0501-cf6a-4278-858b-974c3427b5e4" released by "delete_volume" :: held 0.709s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Created reservations ['d8077840-9c48-4255-baee-9f52737735b0', 'cfba1a54-d4a3-4891-af33-8458e7ba407c', '6cb093e9-1277-41a2-b1b7-b5e8b8f23913', '16b5ede5-805c-4c50-b7f0-8506f42cbfc9'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:35 devstack sudo[116963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:35 devstack sudo[116963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:35 devstack sudo[116959]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.info" returned: 0 in 0.279s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:35 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8547b888-0df6-4c52-b272-4e5ae195d1f2 tempest-ProjectReaderTests-1876340520 None] Create snapshot completed successfully Aug 01 15:26:35 devstack sudo[116963]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.278s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:35 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Deleted volume successfully. Aug 01 15:26:35 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2f076882-2100-4608-9aab-6b6a1a121bd2 tempest-ProjectMemberTests-660978679 None] Lock "cinder-a48d0501-cf6a-4278-858b-974c3427b5e4-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (eda2b624-15e7-4b18-8b67-a23c551d1a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b1a280-051c-4d45-ab11-d72f77ac7f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b1a280-051c-4d45-ab11-d72f77ac7f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1578464069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0db7e9-dff1-4a69-9d18-1066e9fb287e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:36Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38f9f56-e586-4d7e-b20f-7fe6f0e5b5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38f9f56-e586-4d7e-b20f-7fe6f0e5b5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569e0a05-217f-40d8-ade8-d837d5241a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569e0a05-217f-40d8-ade8-d837d5241a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0db7e9-dff1-4a69-9d18-1066e9fb287e', 'volume_name': 'volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fd3b08-5609-4ea2-b1b5-af43a3aad1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fd3b08-5609-4ea2-b1b5-af43a3aad1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accfc32c-2aaa-4e9e-b36a-cc5201fb86a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:36 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Volume ef0db7e9-dff1-4a69-9d18-1066e9fb287e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e', 'volume_size': 1} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1578464069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0db7e9-dff1-4a69-9d18-1066e9fb287e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:36Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Creating volume ef0db7e9-dff1-4a69-9d18-1066e9fb287e {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:26:36 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:36 devstack sudo[116975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e 1073741824 Aug 01 15:26:36 devstack sudo[116975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-09a309ec-3ecf-49f6-880c-3edeba192ac1-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-09a309ec-3ecf-49f6-880c-3edeba192ac1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-559c3fe6-bf95-4187-9645-1801aaa91c03" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-559c3fe6-bf95-4187-9645-1801aaa91c03" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-09a309ec-3ecf-49f6-880c-3edeba192ac1" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-09a309ec-3ecf-49f6-880c-3edeba192ac1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Deleting offline snapshot 09a309ec-3ecf-49f6-880c-3edeba192ac1 of volume 559c3fe6-bf95-4187-9645-1801aaa91c03 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] snapshot_file for this snap is: volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a495930-7e9c-4af1-9e66-4281aec9f126]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:36 devstack sudo[116975]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e 1073741824" returned: 0 in 0.512s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:36 devstack sudo[116983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 Aug 01 15:26:36 devstack sudo[116983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:36 devstack sudo[117013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e Aug 01 15:26:36 devstack sudo[117013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:36 devstack cinder-volume[89024]: INFO cinder.volume.manager [req-09780a7f-b91e-4e40-849c-4a33191a59d4 req-a9af3555-0a98-49e7-a581-2610f9fcc62e tempest-SnapshotDataIntegrityTests-992674527 None] Terminate volume connection completed successfully. Aug 01 15:26:36 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [req-09780a7f-b91e-4e40-849c-4a33191a59d4 req-a9af3555-0a98-49e7-a581-2610f9fcc62e tempest-SnapshotDataIntegrityTests-992674527 None] Deleting attachment 05129cab-e4c8-4cac-a1ec-b5a014d53b47. {{(pid=89024) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 01 15:26:37 devstack sudo[116983]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1" returned: 0 in 0.479s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-559c3fe6-bf95-4187-9645-1801aaa91c03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:37 devstack sudo[117013]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e" returned: 0 in 0.309s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accfc32c-2aaa-4e9e-b36a-cc5201fb86a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc327cc-1bfb-4eae-abc1-612cee64632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4907101-cd39-406f-8089-946acd437b0a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:37 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Volume volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e (ef0db7e9-dff1-4a69-9d18-1066e9fb287e): created successfully Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc327cc-1bfb-4eae-abc1-612cee64632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (eda2b624-15e7-4b18-8b67-a23c551d1a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:37 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b829a27d-dd91-4e7c-8861-5773cae514e5 tempest-ProjectMemberTests-660978679 None] Created volume successfully. Aug 01 15:26:37 devstack sudo[117019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 Aug 01 15:26:37 devstack sudo[117019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:37 devstack sudo[117019]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03" returned: 0 in 0.379s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-2b0290ca-047b-48a8-897c-f0bb2df71acf-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:37 devstack sudo[117024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 Aug 01 15:26:37 devstack sudo[117024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-2b0290ca-047b-48a8-897c-f0bb2df71acf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-2b0290ca-047b-48a8-897c-f0bb2df71acf" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-2b0290ca-047b-48a8-897c-f0bb2df71acf" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[262ad3f8-32f4-4c30-992c-829d46695d91]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:37 devstack sudo[117026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf Aug 01 15:26:37 devstack sudo[117026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:37 devstack sudo[117024]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:37 devstack sudo[117031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1 Aug 01 15:26:37 devstack sudo[117031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:38 devstack sudo[117026]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf" returned: 0 in 0.376s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:38 devstack sudo[117036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf Aug 01 15:26:38 devstack sudo[117036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:38 devstack sudo[117031]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03.09a309ec-3ecf-49f6-880c-3edeba192ac1" returned: 0 in 0.263s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-09a309ec-3ecf-49f6-880c-3edeba192ac1" released by "_delete_snapshot" :: held 1.592s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-559c3fe6-bf95-4187-9645-1801aaa91c03" released by "delete_snapshot" :: held 1.622s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Created reservations ['36b971b0-4918-4421-a0f1-1fb7b492237b', '6ac94ed1-550e-4dec-af7a-33b64f82f7b1', 'af337f8f-8e88-45fa-b6d7-28d95ec9917b', '098236a9-1f3d-4e3f-b3c3-5b0b4dff4e37'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:38 devstack sudo[117036]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2b0290ca-047b-48a8-897c-f0bb2df71acf" returned: 0 in 0.266s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:38 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Delete snapshot completed successfully. Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-2b0290ca-047b-48a8-897c-f0bb2df71acf" released by "delete_volume" :: held 0.689s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-814b10b2-36b4-4ca2-ba54-809e7dac1072 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-09a309ec-3ecf-49f6-880c-3edeba192ac1-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Created reservations ['4a599088-f53f-4821-b232-5993e4bf6436', 'e62d8a2c-a6fb-405c-b7c0-f3b594814c68', 'eb6d503a-0f7a-4fb3-a2d6-f6286d4fcd66', '029f22a2-5882-4dee-bd54-4da3494f771d'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] Creating offline snapshot 2a0609aa-9a57-4fa4-a15b-94095311e3b6 of volume ef0db7e9-dff1-4a69-9d18-1066e9fb287e {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a446c6-b38f-4f74-b74f-e0950d80c77b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:38 devstack sudo[117040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:38 devstack sudo[117040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:38 devstack sudo[117041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e Aug 01 15:26:38 devstack sudo[117041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-559c3fe6-bf95-4187-9645-1801aaa91c03-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-559c3fe6-bf95-4187-9645-1801aaa91c03-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:38 devstack sudo[117040]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.305s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:38 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Deleted volume successfully. Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-28217ada-0817-420b-b106-688f66809a0e tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-2b0290ca-047b-48a8-897c-f0bb2df71acf-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-559c3fe6-bf95-4187-9645-1801aaa91c03" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-559c3fe6-bf95-4187-9645-1801aaa91c03" acquired by "delete_volume" :: waited 0.032s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:38 devstack sudo[117041]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e" returned: 0 in 0.429s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f60ee2a-0f76-4922-910f-b6206915178f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:38 devstack sudo[117048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 1G Aug 01 15:26:38 devstack sudo[117048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[47749914-1fc4-48a2-a1cf-bbd4d357f45e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:39 devstack sudo[117050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 Aug 01 15:26:39 devstack sudo[117050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:39 devstack sudo[117051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 Aug 01 15:26:39 devstack sudo[117051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:39 devstack sudo[117048]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 1G" returned: 0 in 0.414s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:39 devstack sudo[117050]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03" returned: 0 in 0.418s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:39 devstack sudo[117061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 Aug 01 15:26:39 devstack sudo[117061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:39 devstack sudo[117065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03 Aug 01 15:26:39 devstack sudo[117065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:39 devstack sudo[117051]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" returned: 0 in 0.410s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:39 devstack sudo[117068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5 Aug 01 15:26:39 devstack sudo[117068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:39 devstack sudo[117061]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:39 devstack sudo[117065]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6" returned: 0 in 0.300s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:39 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 is being set with open permissions: ugo+rw Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-559c3fe6-bf95-4187-9645-1801aaa91c03" returned: 0 in 0.286s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:39 devstack sudo[117074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 Aug 01 15:26:39 devstack sudo[117074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-559c3fe6-bf95-4187-9645-1801aaa91c03" released by "delete_volume" :: held 0.800s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:39 devstack sudo[117068]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" returned: 0 in 0.269s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5" released by "delete_volume" :: held 0.735s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Created reservations ['353bd95c-2fa3-4dad-a97b-a57c56f83b2f', '06325b3a-fbf4-4e80-a7e1-36c6931e11ee', 'c81b069e-2611-41e9-a75c-a2cd34a8b914', 'c80b2bc3-68d6-4002-98e4-ca46a253d346'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Created reservations ['851230bc-687b-4ce3-b89b-ce6b89dd2e9e', '877df1fa-3893-49ee-8622-1a3bf2a4afe1', '8edc8a74-2e49-4d3e-a9be-cdedd4d6cf5b', 'fa818c26-df32-44c8-a5af-7915a183eaf8'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:39 devstack sudo[117078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:39 devstack sudo[117078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:39 devstack sudo[117074]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6" returned: 0 in 0.269s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:39 devstack sudo[117080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:39 devstack sudo[117080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:40 devstack sudo[117082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.info Aug 01 15:26:40 devstack sudo[117082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:40 devstack sudo[117078]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.334s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Deleted volume successfully. Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-10a2a6a1-97fd-4b4c-904f-eb875cf73c45 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-559c3fe6-bf95-4187-9645-1801aaa91c03-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-e39f0131-2018-46dc-a3af-2fe4c56f3687-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-e39f0131-2018-46dc-a3af-2fe4c56f3687-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:40 devstack sudo[117080]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.415s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Deleted volume successfully. Aug 01 15:26:40 devstack sudo[117082]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.info" returned: 0 in 0.408s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:40 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.info is being set with open permissions: ugo+rw Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-e39f0131-2018-46dc-a3af-2fe4c56f3687" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eb9e88ef-d261-489d-aa92-4208ac23c9ce tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-8a85b8cc-65c4-47f5-a261-4c09f9d1dab5-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-e39f0131-2018-46dc-a3af-2fe4c56f3687" acquired by "delete_volume" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:40 devstack sudo[117088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.info Aug 01 15:26:40 devstack sudo[117088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bc11c4-a1b5-4f22-b644-d49df72b29d4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:40 devstack sudo[117090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 Aug 01 15:26:40 devstack sudo[117090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (cdc7ac98-67d5-45bb-9ff1-50a2c8396be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a95a73-9ebe-4662-a09a-73c5054bf121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:40 devstack sudo[117088]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.info" returned: 0 in 0.291s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.260s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a95a73-9ebe-4662-a09a-73c5054bf121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665270109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed36f4cf-a12c-4615-9294-074794e571a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:41Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d7639e-788b-4dc4-81a0-871397711126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d7639e-788b-4dc4-81a0-871397711126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7abeec4d-968e-437f-97eb-e5168b322d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7abeec4d-968e-437f-97eb-e5168b322d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed36f4cf-a12c-4615-9294-074794e571a7', 'volume_name': 'volume-ed36f4cf-a12c-4615-9294-074794e571a7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90ab233-728b-485b-ae4e-795ba37af33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90ab233-728b-485b-ae4e-795ba37af33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ae10f0-6619-4f0e-bba7-25aa78f21d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:40 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Volume ed36f4cf-a12c-4615-9294-074794e571a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed36f4cf-a12c-4615-9294-074794e571a7', 'volume_size': 1} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665270109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed36f4cf-a12c-4615-9294-074794e571a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:41Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Creating volume ed36f4cf-a12c-4615-9294-074794e571a7 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:26:40 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:40 devstack sudo[117093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7 1073741824 Aug 01 15:26:40 devstack sudo[117093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:40 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-49cee373-0890-401c-9fa8-7019717fa4e4 tempest-ProjectMemberTests-660978679 None] Create snapshot completed successfully Aug 01 15:26:40 devstack sudo[117090]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687" returned: 0 in 0.402s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:40 devstack sudo[117098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687 Aug 01 15:26:40 devstack sudo[117098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:41 devstack sudo[117098]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-e39f0131-2018-46dc-a3af-2fe4c56f3687" returned: 0 in 0.248s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-e39f0131-2018-46dc-a3af-2fe4c56f3687" released by "delete_volume" :: held 0.731s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Created reservations ['baf9058a-9f11-4222-9b14-2737081f7c7c', '53f80188-66a2-415d-a99c-e10956b0a88c', 'd3c5a0bf-ba79-4855-8101-d4506d457d6f', '044f5a4f-8088-43a7-a6a1-59572422fdaa'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:41 devstack sudo[117093]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7 1073741824" returned: 0 in 0.470s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:41 devstack sudo[117104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7 Aug 01 15:26:41 devstack sudo[117104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:41 devstack sudo[117105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:41 devstack sudo[117105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-a4257430-12a7-449c-b348-2ea91037d7bb-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-a4257430-12a7-449c-b348-2ea91037d7bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-a4257430-12a7-449c-b348-2ea91037d7bb" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-a4257430-12a7-449c-b348-2ea91037d7bb" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Deleting offline snapshot a4257430-12a7-449c-b348-2ea91037d7bb of volume 5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:26:41 devstack sudo[117104]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] snapshot_file for this snap is: volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7" returned: 0 in 0.314s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[499211eb-bc39-4967-a5df-9f09b4e46e7e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ae10f0-6619-4f0e-bba7-25aa78f21d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed36f4cf-a12c-4615-9294-074794e571a7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17143042-7a11-4d13-934d-4f2438500eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:41 devstack sudo[117105]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.349s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:41 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Volume volume-ed36f4cf-a12c-4615-9294-074794e571a7 (ed36f4cf-a12c-4615-9294-074794e571a7): created successfully Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17143042-7a11-4d13-934d-4f2438500eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (cdc7ac98-67d5-45bb-9ff1-50a2c8396be5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-2a0609aa-9a57-4fa4-a15b-94095311e3b6-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:41 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Deleted volume successfully. Aug 01 15:26:41 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a751c48c-638c-4630-bc48-93d51c941f1c tempest-ProjectReaderTests-1876340520 None] Created volume successfully. Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Lock "cinder-2a0609aa-9a57-4fa4-a15b-94095311e3b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-ef0db7e9-dff1-4a69-9d18-1066e9fb287e" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-549a42d2-7bff-45b4-a761-38854034efae tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-e39f0131-2018-46dc-a3af-2fe4c56f3687-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-ef0db7e9-dff1-4a69-9d18-1066e9fb287e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-2a0609aa-9a57-4fa4-a15b-94095311e3b6" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:41 devstack sudo[117110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb Aug 01 15:26:41 devstack sudo[117110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-2a0609aa-9a57-4fa4-a15b-94095311e3b6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Deleting offline snapshot 2a0609aa-9a57-4fa4-a15b-94095311e3b6 of volume ef0db7e9-dff1-4a69-9d18-1066e9fb287e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] snapshot_file for this snap is: volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c93b67-ec82-4c99-9a29-a2a07252b830]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:41 devstack sudo[117112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 Aug 01 15:26:41 devstack sudo[117112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:42 devstack sudo[117110]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb" returned: 0 in 0.431s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7256d21-312b-4dd8-95f9-793854ebd423]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:42 devstack sudo[117117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 Aug 01 15:26:42 devstack sudo[117117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:42 devstack sudo[117112]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6" returned: 0 in 0.394s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ce1056-ff4a-47f4-b5bf-fba368897fe8]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:42 devstack sudo[117122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e Aug 01 15:26:42 devstack sudo[117122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:42 devstack sudo[117117]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832" returned: 0 in 0.382s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:42 devstack sudo[117127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb Aug 01 15:26:42 devstack sudo[117127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:42 devstack sudo[117122]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e" returned: 0 in 0.383s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:42 devstack sudo[117132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 Aug 01 15:26:42 devstack sudo[117132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] Creating offline snapshot 29b1141e-e7fe-4011-a7ed-b4398018733a of volume ed36f4cf-a12c-4615-9294-074794e571a7 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d9fd46-9f1a-41fb-9741-79a99b01d89a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:42 devstack sudo[117132]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6" returned: 0 in 0.405s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:43 devstack sudo[117141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6 Aug 01 15:26:43 devstack sudo[117141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:43 devstack sudo[117140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7 Aug 01 15:26:43 devstack sudo[117140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:43 devstack sudo[117127]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb" returned: 0 in 0.682s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:43 devstack sudo[117144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb Aug 01 15:26:43 devstack sudo[117144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:43 devstack sudo[117141]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e.2a0609aa-9a57-4fa4-a15b-94095311e3b6" returned: 0 in 0.260s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-2a0609aa-9a57-4fa4-a15b-94095311e3b6" released by "_delete_snapshot" :: held 1.549s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-ef0db7e9-dff1-4a69-9d18-1066e9fb287e" released by "delete_snapshot" :: held 1.579s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:43 devstack sudo[117140]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7" returned: 0 in 0.408s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.29b1141e-e7fe-4011-a7ed-b4398018733a 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:43 devstack sudo[117152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.29b1141e-e7fe-4011-a7ed-b4398018733a 1G Aug 01 15:26:43 devstack sudo[117152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:43 devstack sudo[117144]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.a4257430-12a7-449c-b348-2ea91037d7bb" returned: 0 in 0.266s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Created reservations ['d080467d-37fd-4e59-b077-cac4b199199b', 'd8cfc196-2836-47fd-a0ce-462cfe70c6db', '30aa6bfc-17ca-4112-9663-0b8e6640d00c', 'de469d85-f731-44ec-aea0-a9ab351115ac'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-a4257430-12a7-449c-b348-2ea91037d7bb" released by "_delete_snapshot" :: held 1.891s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" released by "delete_snapshot" :: held 1.936s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Delete snapshot completed successfully. Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-8312a2eb-765a-437b-ab65-cc3d53c7b1a9 tempest-ProjectMemberTests-660978679 None] Lock "cinder-2a0609aa-9a57-4fa4-a15b-94095311e3b6-delete_snapshot" released by "delete_snapshot" :: held 1.793s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Created reservations ['da75ac17-c8dd-4e20-b55f-34ae6008842a', '726f8f76-6d5b-4868-b1b8-b76a1d1650f8', 'a8514bd8-3f71-4107-8588-20d1c27db4fc', 'ccf539e0-86b9-4cb3-910a-ff32979b2597'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Delete snapshot completed successfully. Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-52104287-1eed-4a2e-86db-313abecf561c tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-a4257430-12a7-449c-b348-2ea91037d7bb-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:43 devstack sudo[117152]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.29b1141e-e7fe-4011-a7ed-b4398018733a 1G" returned: 0 in 0.421s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed36f4cf-a12c-4615-9294-074794e571a7 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.29b1141e-e7fe-4011-a7ed-b4398018733a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:43 devstack sudo[117158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed36f4cf-a12c-4615-9294-074794e571a7 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.29b1141e-e7fe-4011-a7ed-b4398018733a Aug 01 15:26:43 devstack sudo[117158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-ef0db7e9-dff1-4a69-9d18-1066e9fb287e-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Lock "cinder-ef0db7e9-dff1-4a69-9d18-1066e9fb287e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-ef0db7e9-dff1-4a69-9d18-1066e9fb287e" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-ef0db7e9-dff1-4a69-9d18-1066e9fb287e" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[baed61b0-57a2-4f9b-9dd9-8de7ad2e44d6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:44 devstack sudo[117158]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed36f4cf-a12c-4615-9294-074794e571a7 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.29b1141e-e7fe-4011-a7ed-b4398018733a" returned: 0 in 0.322s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:44 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.29b1141e-e7fe-4011-a7ed-b4398018733a is being set with open permissions: ugo+rw Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.29b1141e-e7fe-4011-a7ed-b4398018733a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:44 devstack sudo[117160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e Aug 01 15:26:44 devstack sudo[117160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:44 devstack sudo[117165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.29b1141e-e7fe-4011-a7ed-b4398018733a Aug 01 15:26:44 devstack sudo[117165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:44 devstack sudo[117165]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.29b1141e-e7fe-4011-a7ed-b4398018733a" returned: 0 in 0.250s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:44 devstack sudo[117160]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e" returned: 0 in 0.378s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:44 devstack sudo[117172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e Aug 01 15:26:44 devstack sudo[117172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:44 devstack sudo[117174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.info Aug 01 15:26:44 devstack sudo[117174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:44 devstack sudo[117172]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ef0db7e9-dff1-4a69-9d18-1066e9fb287e" returned: 0 in 0.259s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-ef0db7e9-dff1-4a69-9d18-1066e9fb287e" released by "delete_volume" :: held 0.709s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:44 devstack sudo[117174]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.info" returned: 0 in 0.265s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:44 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.info is being set with open permissions: ugo+rw Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-cda4bdf3-fa9d-48fb-96fb-3a39e482f832-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:44 devstack sudo[117178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.info Aug 01 15:26:44 devstack sudo[117178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-cda4bdf3-fa9d-48fb-96fb-3a39e482f832-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-cda4bdf3-fa9d-48fb-96fb-3a39e482f832" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-cda4bdf3-fa9d-48fb-96fb-3a39e482f832" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Deleting offline snapshot cda4bdf3-fa9d-48fb-96fb-3a39e482f832 of volume 5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] snapshot_file for this snap is: volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd0993f-7de8-4724-a473-c29d2f61a9e4]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Created reservations ['07b54649-8df9-477e-9858-464d5ce62872', 'c02e1664-d48d-4cb7-b9c2-ad73c200e4ed', '86c93603-99cc-4ee3-a1b5-efb39a0c5689', '4154fcd2-3db5-4fee-96f9-4eacb10b0eeb'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:44 devstack sudo[117181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:44 devstack sudo[117181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:44 devstack sudo[117180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 Aug 01 15:26:44 devstack sudo[117180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:44 devstack sudo[117178]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-ed36f4cf-a12c-4615-9294-074794e571a7.info" returned: 0 in 0.280s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:44 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-d408dd22-76a2-4423-8b69-bb6d4bb044a2 tempest-ProjectReaderTests-1876340520 None] Create snapshot completed successfully Aug 01 15:26:45 devstack sudo[117181]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.272s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:45 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Deleted volume successfully. Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-eac91a27-8e20-4daa-9563-b1df6055b472 tempest-ProjectMemberTests-660978679 None] Lock "cinder-ef0db7e9-dff1-4a69-9d18-1066e9fb287e-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:45 devstack sudo[117180]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832" returned: 0 in 0.448s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cec583a-46b2-481a-aaf3-50b25b4cae3c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:45 devstack sudo[117190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 Aug 01 15:26:45 devstack sudo[117190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (58e28f0f-6b74-4238-9d78-34212f4dc511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6647de91-1392-40ea-9760-0f32b1c6a498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6647de91-1392-40ea-9760-0f32b1c6a498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888353773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d911962a-afc6-48d2-83c2-bae2984bf89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:45Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13427af-c25c-4420-a203-3d0d169794d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13427af-c25c-4420-a203-3d0d169794d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4b7d2d-a2ad-4a0a-b132-6f154c1ce957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc4b7d2d-a2ad-4a0a-b132-6f154c1ce957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd911962a-afc6-48d2-83c2-bae2984bf89f', 'volume_name': 'volume-d911962a-afc6-48d2-83c2-bae2984bf89f', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2318967c-8efb-4602-9a68-a6ab54123d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2318967c-8efb-4602-9a68-a6ab54123d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e1d274-0828-4d1f-83fa-310aa1802593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:45 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Volume d911962a-afc6-48d2-83c2-bae2984bf89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d911962a-afc6-48d2-83c2-bae2984bf89f', 'volume_size': 1} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888353773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d911962a-afc6-48d2-83c2-bae2984bf89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:45Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Creating volume d911962a-afc6-48d2-83c2-bae2984bf89f {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:45 devstack sudo[117190]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:26:45 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50" returned: 0 in 0.384s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:45 devstack sudo[117195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f 1073741824 Aug 01 15:26:45 devstack sudo[117195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:45 devstack sudo[117196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 Aug 01 15:26:45 devstack sudo[117196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:46 devstack sudo[117195]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f 1073741824" returned: 0 in 0.420s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-26a619c8-c1f8-4bd7-ae1a-da79d6b82e66 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-29b1141e-e7fe-4011-a7ed-b4398018733a-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-26a619c8-c1f8-4bd7-ae1a-da79d6b82e66 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-29b1141e-e7fe-4011-a7ed-b4398018733a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:46 devstack cinder-volume[89024]: INFO cinder.message.api [None req-26a619c8-c1f8-4bd7-ae1a-da79d6b82e66 tempest-ProjectReaderTests-1876340520 None] Creating message record for request_id = req-26a619c8-c1f8-4bd7-ae1a-da79d6b82e66 Aug 01 15:26:46 devstack sudo[117209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f Aug 01 15:26:46 devstack sudo[117209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-26a619c8-c1f8-4bd7-ae1a-da79d6b82e66 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-29b1141e-e7fe-4011-a7ed-b4398018733a-delete_snapshot" released by "delete_snapshot" :: held 0.057s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:46 devstack sudo[117196]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server [None req-26a619c8-c1f8-4bd7-ae1a-da79d6b82e66 tempest-ProjectReaderTests-1876340520 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server return f(*a, **k) Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server raise self.value Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Aug 01 15:26:46 devstack cinder-volume[89024]: ERROR oslo_messaging.rpc.server Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832" returned: 0 in 0.547s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:46 devstack sudo[117211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832 Aug 01 15:26:46 devstack sudo[117211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:46 devstack sudo[117209]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f" returned: 0 in 0.251s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e1d274-0828-4d1f-83fa-310aa1802593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d911962a-afc6-48d2-83c2-bae2984bf89f', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729fe1a6-60f6-489d-a51c-98f8ce1eb733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Volume volume-d911962a-afc6-48d2-83c2-bae2984bf89f (d911962a-afc6-48d2-83c2-bae2984bf89f): created successfully Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729fe1a6-60f6-489d-a51c-98f8ce1eb733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (58e28f0f-6b74-4238-9d78-34212f4dc511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:46 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c2e3e1bc-df6d-4285-b6eb-1d02a195a3bf tempest-ProjectMemberTests-660978679 None] Created volume successfully. Aug 01 15:26:46 devstack sudo[117211]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.cda4bdf3-fa9d-48fb-96fb-3a39e482f832" returned: 0 in 0.264s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-cda4bdf3-fa9d-48fb-96fb-3a39e482f832" released by "_delete_snapshot" :: held 1.741s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" released by "delete_snapshot" :: held 1.769s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Created reservations ['e135be30-5aa0-47b2-99da-cebd4f9ea302', 'afbb9986-5515-4e21-930c-a00a8291f474', 'eb8eeb08-c04b-4f3b-b646-c92154f096ce', '74704e20-c016-44f4-8839-2b5276cdbb3c'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:46 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Delete snapshot completed successfully. Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-9a877473-2406-471e-9d61-89a268d5e2e2 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-cda4bdf3-fa9d-48fb-96fb-3a39e482f832-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] Creating offline snapshot 9796a616-69ab-477d-ac7a-a34bb6345434 of volume d911962a-afc6-48d2-83c2-bae2984bf89f {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5024d2d5-6930-4b6a-adb7-67a04927e247]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-1c00346e-7d5d-4b93-92ce-c40efc28fb50-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-1c00346e-7d5d-4b93-92ce-c40efc28fb50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:46 devstack sudo[117215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f Aug 01 15:26:46 devstack sudo[117215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-1c00346e-7d5d-4b93-92ce-c40efc28fb50" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-1c00346e-7d5d-4b93-92ce-c40efc28fb50" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Deleting offline snapshot 1c00346e-7d5d-4b93-92ce-c40efc28fb50 of volume 5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] snapshot_file for this snap is: volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f778368-d7c4-46c1-af66-ee041618e882]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:47 devstack sudo[117217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 Aug 01 15:26:47 devstack sudo[117217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:47 devstack sudo[117215]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f" returned: 0 in 0.381s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:47 devstack sudo[117222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 1G Aug 01 15:26:47 devstack sudo[117222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:47 devstack sudo[117217]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50" returned: 0 in 0.369s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5194739a-d327-4411-ad5f-23e1c7cfc79e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7433f4-409b-407b-b566-d217dc8aa527]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:47 devstack sudo[117227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e Aug 01 15:26:47 devstack sudo[117227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:47 devstack sudo[117222]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 1G" returned: 0 in 0.421s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d911962a-afc6-48d2-83c2-bae2984bf89f -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:47 devstack sudo[117232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d911962a-afc6-48d2-83c2-bae2984bf89f -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 Aug 01 15:26:47 devstack sudo[117232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:47 devstack sudo[117227]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e" returned: 0 in 0.370s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:47 devstack sudo[117237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 Aug 01 15:26:47 devstack sudo[117237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:47 devstack sudo[117232]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d911962a-afc6-48d2-83c2-bae2984bf89f -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434" returned: 0 in 0.287s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:47 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 is being set with open permissions: ugo+rw Aug 01 15:26:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:47 devstack sudo[117242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 Aug 01 15:26:47 devstack sudo[117242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:48 devstack sudo[117237]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50" returned: 0 in 0.385s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:48 devstack sudo[117253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50 Aug 01 15:26:48 devstack sudo[117253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:48 devstack sudo[117242]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434" returned: 0 in 0.275s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:48 devstack sudo[117255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.info Aug 01 15:26:48 devstack sudo[117255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:48 devstack sudo[117253]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e.1c00346e-7d5d-4b93-92ce-c40efc28fb50" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-1c00346e-7d5d-4b93-92ce-c40efc28fb50" released by "_delete_snapshot" :: held 1.465s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" released by "delete_snapshot" :: held 1.488s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:48 devstack sudo[117255]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.info" returned: 0 in 0.275s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:48 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.info is being set with open permissions: ugo+rw Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Created reservations ['f202481d-e266-447e-af35-56ffb8501b23', 'ff068866-7876-4d9b-aa32-beb39947b802', 'deba6c0f-be8d-4d78-9097-aa66457ffda3', 'a27402c8-b068-42e2-9b58-ec6307c7ea87'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:48 devstack sudo[117259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.info Aug 01 15:26:48 devstack sudo[117259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Delete snapshot completed successfully. Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b5b73fa-7b50-4edc-a76c-a61dc3159c03 tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-1c00346e-7d5d-4b93-92ce-c40efc28fb50-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:48 devstack sudo[117259]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.info" returned: 0 in 0.243s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:48 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-899896dc-36be-4c56-80b0-a0dd6542b537 tempest-ProjectMemberTests-660978679 None] Create snapshot completed successfully Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-9796a616-69ab-477d-ac7a-a34bb6345434-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Lock "cinder-9796a616-69ab-477d-ac7a-a34bb6345434-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-d911962a-afc6-48d2-83c2-bae2984bf89f" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-d911962a-afc6-48d2-83c2-bae2984bf89f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-9796a616-69ab-477d-ac7a-a34bb6345434" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-9796a616-69ab-477d-ac7a-a34bb6345434" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Deleting offline snapshot 9796a616-69ab-477d-ac7a-a34bb6345434 of volume d911962a-afc6-48d2-83c2-bae2984bf89f {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] snapshot_file for this snap is: volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fcdef0-4007-4be9-adfe-414de479b34e]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:48 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:49 devstack sudo[117262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 Aug 01 15:26:49 devstack sudo[117262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-5194739a-d327-4411-ad5f-23e1c7cfc79e-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-5194739a-d327-4411-ad5f-23e1c7cfc79e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" acquired by "delete_volume" :: waited 0.029s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1245f-010a-4cc4-b539-9e4c0bdf3f9c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:49 devstack sudo[117262]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434" returned: 0 in 0.391s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d911962a-afc6-48d2-83c2-bae2984bf89f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[036136ca-c21c-4c2b-aa35-629a991a0817]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:49 devstack sudo[117267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e Aug 01 15:26:49 devstack sudo[117267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:49 devstack sudo[117268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f Aug 01 15:26:49 devstack sudo[117268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:49 devstack sudo[117267]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e" returned: 0 in 0.399s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:49 devstack sudo[117276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e Aug 01 15:26:49 devstack sudo[117276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:49 devstack sudo[117268]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f" returned: 0 in 0.390s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:49 devstack sudo[117279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 Aug 01 15:26:49 devstack sudo[117279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:49 devstack sudo[117276]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-5194739a-d327-4411-ad5f-23e1c7cfc79e" returned: 0 in 0.251s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-quobyte-5194739a-d327-4411-ad5f-23e1c7cfc79e" released by "delete_volume" :: held 0.718s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:49 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Created reservations ['13f10761-151d-4f03-9d30-93b934c571ba', '62fe4f26-2074-4407-80f0-b0fe3424b3af', '9e06b71c-fb0f-4f33-8f15-2e57daa402a3', '9d2dc74f-d2ee-4ac0-80b0-0a816d3461a1'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:50 devstack sudo[117285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:50 devstack sudo[117285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:50 devstack sudo[117279]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434" returned: 0 in 0.395s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:50 devstack sudo[117287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434 Aug 01 15:26:50 devstack sudo[117287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:50 devstack sudo[117285]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.285s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Deleted volume successfully. Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-679d7f9f-685d-4aac-885a-85606ea4c12f tempest-SnapshotDataIntegrityTests-992674527 None] Lock "cinder-5194739a-d327-4411-ad5f-23e1c7cfc79e-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:50 devstack sudo[117287]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f.9796a616-69ab-477d-ac7a-a34bb6345434" returned: 0 in 0.289s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-9796a616-69ab-477d-ac7a-a34bb6345434" released by "_delete_snapshot" :: held 1.569s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-d911962a-afc6-48d2-83c2-bae2984bf89f" released by "delete_snapshot" :: held 1.596s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Created reservations ['6e5df5f0-6ff7-42ec-b50b-8485a9d159ff', '4f37a344-caeb-4781-8640-0bf8900c5436', '24989d35-01eb-4380-8d63-8e4755134469', '8e2fa946-eee6-4360-a145-78bbf9349c47'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:50 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Delete snapshot completed successfully. Aug 01 15:26:50 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-38a6e0e0-1860-47a0-98f6-6b8ac968fd87 tempest-ProjectMemberTests-660978679 None] Lock "cinder-9796a616-69ab-477d-ac7a-a34bb6345434-delete_snapshot" released by "delete_snapshot" :: held 1.763s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-d911962a-afc6-48d2-83c2-bae2984bf89f-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Lock "cinder-d911962a-afc6-48d2-83c2-bae2984bf89f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-d911962a-afc6-48d2-83c2-bae2984bf89f" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-d911962a-afc6-48d2-83c2-bae2984bf89f" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:51 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82eda55-47dc-4375-8ea6-5ab18de58def]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:51 devstack sudo[117316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f Aug 01 15:26:51 devstack sudo[117316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:51 devstack sudo[117316]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f" returned: 0 in 0.424s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:51 devstack sudo[117321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f Aug 01 15:26:51 devstack sudo[117321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:51 devstack sudo[117321]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:51 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-d911962a-afc6-48d2-83c2-bae2984bf89f" returned: 0 in 0.277s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:51 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-d911962a-afc6-48d2-83c2-bae2984bf89f" released by "delete_volume" :: held 0.787s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Created reservations ['7ea1f791-f24b-4294-bafa-f2f1c9c90c68', 'ff8cf326-10af-412d-9791-07769d1fce30', '1fcb2082-3d9e-44c1-b0a7-6ff239763e7a', '4d8d33d7-a42f-49b0-b893-81c546e9da4f'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:52 devstack sudo[117327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:26:52 devstack sudo[117327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:52 devstack sudo[117327]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.276s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:26:52 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Deleted volume successfully. Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b15163de-37bf-4027-8083-13049db9f634 tempest-ProjectMemberTests-660978679 None] Lock "cinder-d911962a-afc6-48d2-83c2-bae2984bf89f-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (678b420d-29ba-4653-ae14-444276072d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484c8266-3330-4ce7-a767-93ee815ad416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484c8266-3330-4ce7-a767-93ee815ad416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2140874928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:53Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e3b1d7-2f99-48ac-91e2-7e2b50b757dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e3b1d7-2f99-48ac-91e2-7e2b50b757dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5993fd50-a8b7-472d-bb60-66f9f86eaa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5993fd50-a8b7-472d-bb60-66f9f86eaa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d', 'volume_name': 'volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661820ba-fe8d-4af5-8fd9-77d2945029b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661820ba-fe8d-4af5-8fd9-77d2945029b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d670191-3795-428e-8534-b1865e294d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:52 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Volume 24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d', 'volume_size': 1} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2140874928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:26:53Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Creating volume 24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:26:52 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:26:52 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:52 devstack sudo[117331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d 1073741824 Aug 01 15:26:52 devstack sudo[117331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:53 devstack sudo[117331]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d 1073741824" returned: 0 in 0.508s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:53 devstack sudo[117337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d Aug 01 15:26:53 devstack sudo[117337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:53 devstack sudo[117337]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d" returned: 0 in 0.283s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:53 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:26:53 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d670191-3795-428e-8534-b1865e294d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4c2211-ded5-430a-bd40-cdaabe6f309e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:26:53 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Volume volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d (24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d): created successfully Aug 01 15:26:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4c2211-ded5-430a-bd40-cdaabe6f309e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:26:53 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (678b420d-29ba-4653-ae14-444276072d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:26:53 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-26f2c256-389a-4366-8d02-4decf0675b52 tempest-ProjectMemberTests-660978679 None] Created volume successfully. Aug 01 15:26:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:26:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:26:55 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] Creating offline snapshot 4036cad9-7605-4b60-8875-87258e40aabc of volume 24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:26:55 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb5b56e-56c4-456b-9cf5-d718a92b67a5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:55 devstack sudo[117340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d Aug 01 15:26:55 devstack sudo[117340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:55 devstack sudo[117340]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d" returned: 0 in 0.361s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:55 devstack sudo[117345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc 1G Aug 01 15:26:55 devstack sudo[117345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:55 devstack sudo[117345]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc 1G" returned: 0 in 0.444s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:55 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:55 devstack sudo[117351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc Aug 01 15:26:55 devstack sudo[117351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:56 devstack sudo[117351]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc" returned: 0 in 0.308s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:56 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc is being set with open permissions: ugo+rw Aug 01 15:26:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:56 devstack sudo[117357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc Aug 01 15:26:56 devstack sudo[117357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:56 devstack sudo[117357]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc" returned: 0 in 0.277s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:56 devstack sudo[117360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.info Aug 01 15:26:56 devstack sudo[117360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:56 devstack sudo[117360]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.info" returned: 0 in 0.287s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:56 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.info is being set with open permissions: ugo+rw Aug 01 15:26:56 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:56 devstack sudo[117363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.info Aug 01 15:26:56 devstack sudo[117363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:57 devstack sudo[117363]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.info" returned: 0 in 0.312s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:57 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:26:57 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-939052b9-2ddc-4bed-8d0d-444a3ba73dde tempest-ProjectMemberTests-660978679 None] Create snapshot completed successfully Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-4036cad9-7605-4b60-8875-87258e40aabc-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-4036cad9-7605-4b60-8875-87258e40aabc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-4036cad9-7605-4b60-8875-87258e40aabc" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-4036cad9-7605-4b60-8875-87258e40aabc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Deleting offline snapshot 4036cad9-7605-4b60-8875-87258e40aabc of volume 24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] snapshot_file for this snap is: volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c83dcdc-b847-4c32-9e9a-81f0f152c9be]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:58 devstack sudo[117367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc Aug 01 15:26:58 devstack sudo[117367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:58 devstack sudo[117367]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc" returned: 0 in 0.362s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9039172-34da-4cea-a5bd-bfb4a343a567]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:26:58 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:58 devstack sudo[117372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d Aug 01 15:26:58 devstack sudo[117372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:59 devstack sudo[117372]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d" returned: 0 in 0.381s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:59 devstack sudo[117379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc Aug 01 15:26:59 devstack sudo[117379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:59 devstack sudo[117379]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc" returned: 0 in 0.362s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:26:59 devstack sudo[117384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc Aug 01 15:26:59 devstack sudo[117384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:26:59 devstack sudo[117384]: pam_unix(sudo:session): session closed for user root Aug 01 15:26:59 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d.4036cad9-7605-4b60-8875-87258e40aabc" returned: 0 in 0.284s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:26:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-4036cad9-7605-4b60-8875-87258e40aabc" released by "_delete_snapshot" :: held 1.520s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d" released by "delete_snapshot" :: held 1.550s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:26:59 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=172,cinder:UPDATE=226,cinder:INSERT=60,cinder:DELETE=17 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:26:59 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Created reservations ['5e0cc7e2-3d97-4155-9f45-3aaa71058120', 'f934c2a0-aa49-499c-a6ba-d6e39c9c5c6a', '3c081787-1ff0-4273-a91e-b92a9229d542', '6d9ae6e4-850b-4109-af80-09a626bafb84'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:26:59 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Delete snapshot completed successfully. Aug 01 15:26:59 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-47846be4-3903-4c37-b8ec-b9ed62624d76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-4036cad9-7605-4b60-8875-87258e40aabc-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Lock "cinder-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:00 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d" acquired by "delete_volume" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:00 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce708a99-2325-44ed-859b-7c06ab2b16f5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:27:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:00 devstack sudo[117388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d Aug 01 15:27:00 devstack sudo[117388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:00 devstack sudo[117388]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d" returned: 0 in 0.386s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:00 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:00 devstack sudo[117396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d Aug 01 15:27:00 devstack sudo[117396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:01 devstack sudo[117396]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d" returned: 0 in 0.292s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d" released by "delete_volume" :: held 0.739s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Created reservations ['8dfc4ad6-e63c-4012-8e3e-df32154c6f72', 'e5dead2a-4679-444f-967a-30f8e90d2290', '9bdc91c9-1ed2-4c19-95f4-5e4800ceedf8', 'b2cc989a-9190-4c6c-92b9-32e195a7f142'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:01 devstack sudo[117399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:27:01 devstack sudo[117399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:01 devstack sudo[117399]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.272s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:27:01 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Deleted volume successfully. Aug 01 15:27:01 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c06aec69-35ab-40c3-8426-e06ba583c931 tempest-ProjectMemberTests-660978679 None] Lock "cinder-24d16c94-d6c7-4d6b-a3e3-3e0b0c46934d-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (18315996-904a-41db-b854-15c7002148ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc5cd5f-05c9-4ce3-95c1-d03efc1f347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc5cd5f-05c9-4ce3-95c1-d03efc1f347e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188164219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:02Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98e685d-95bf-4fb0-bc76-008ae03e23a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98e685d-95bf-4fb0-bc76-008ae03e23a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e988e2-12f8-4a2c-b090-6f3fc0f474cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e988e2-12f8-4a2c-b090-6f3fc0f474cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64', 'volume_name': 'volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36daf2b1-221f-471e-bbb2-9ba1cbb29baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36daf2b1-221f-471e-bbb2-9ba1cbb29baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ef3d3d-a8ef-48cb-aa2c-650974d6c669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:02 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Volume f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64', 'volume_size': 1} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188164219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1adfb3ee2b043bfa86ce45dfa3fad7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:02Z,use_quota=True,user_id='51c9d11db58e4e3085dd13202a45997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Creating volume f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:27:02 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:02 devstack sudo[117402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 1073741824 Aug 01 15:27:02 devstack sudo[117402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:02 devstack sudo[117402]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 1073741824" returned: 0 in 0.461s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:02 devstack sudo[117408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 Aug 01 15:27:02 devstack sudo[117408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:02 devstack sudo[117408]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64" returned: 0 in 0.269s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:27:02 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ef3d3d-a8ef-48cb-aa2c-650974d6c669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6601a02c-aace-42c0-9c93-07ad2605e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Volume volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 (f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64): created successfully Aug 01 15:27:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6601a02c-aace-42c0-9c93-07ad2605e18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Flow 'volume_create_manager' (18315996-904a-41db-b854-15c7002148ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:03 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ee5717a6-995b-40d1-901a-75f28e2b7443 tempest-ProjectMemberTests-660978679 None] Created volume successfully. Aug 01 15:27:04 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=190,cinder:UPDATE=202,cinder:INSERT=57,cinder:DELETE=17 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:27:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] Creating offline snapshot 27fa4a44-3d53-46fd-93c6-bdfb45515800 of volume f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:27:04 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e6f8a1-fc83-46d2-baf5-a2215cddfb2d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:27:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:04 devstack sudo[117411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 Aug 01 15:27:04 devstack sudo[117411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:04 devstack sudo[117411]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64" returned: 0 in 0.347s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:04 devstack sudo[117417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 1G Aug 01 15:27:04 devstack sudo[117417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:05 devstack sudo[117417]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 1G" returned: 0 in 0.387s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:05 devstack sudo[117423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 Aug 01 15:27:05 devstack sudo[117423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:05 devstack sudo[117423]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800" returned: 0 in 0.303s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:05 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 is being set with open permissions: ugo+rw Aug 01 15:27:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:05 devstack sudo[117428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 Aug 01 15:27:05 devstack sudo[117428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:05 devstack sudo[117428]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800" returned: 0 in 0.235s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:05 devstack sudo[117431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.info Aug 01 15:27:05 devstack sudo[117431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:05 devstack sudo[117431]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.info" returned: 0 in 0.255s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:05 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.info is being set with open permissions: ugo+rw Aug 01 15:27:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:05 devstack sudo[117434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.info Aug 01 15:27:05 devstack sudo[117434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:06 devstack sudo[117434]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.info" returned: 0 in 0.243s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:06 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-22e2e870-052c-483f-b4b7-d596cfc18ef7 tempest-ProjectMemberTests-660978679 None] Create snapshot completed successfully Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-27fa4a44-3d53-46fd-93c6-bdfb45515800-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-27fa4a44-3d53-46fd-93c6-bdfb45515800-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-27fa4a44-3d53-46fd-93c6-bdfb45515800" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-27fa4a44-3d53-46fd-93c6-bdfb45515800" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Deleting offline snapshot 27fa4a44-3d53-46fd-93c6-bdfb45515800 of volume f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] snapshot_file for this snap is: volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d17868d-9ba2-4d83-8f0f-adce68d36451]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:06 devstack sudo[117437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 Aug 01 15:27:06 devstack sudo[117437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:06 devstack sudo[117437]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800" returned: 0 in 0.354s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4ff9f3-f36d-4ba4-a398-381b7d82a15f]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:27:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:07 devstack sudo[117442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 Aug 01 15:27:07 devstack sudo[117442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:07 devstack sudo[117442]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64" returned: 0 in 0.353s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:07 devstack sudo[117447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 Aug 01 15:27:07 devstack sudo[117447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:07 devstack sudo[117447]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800" returned: 0 in 0.332s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:07 devstack sudo[117452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800 Aug 01 15:27:07 devstack sudo[117452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:07 devstack sudo[117452]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64.27fa4a44-3d53-46fd-93c6-bdfb45515800" returned: 0 in 0.242s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-27fa4a44-3d53-46fd-93c6-bdfb45515800" released by "_delete_snapshot" :: held 1.365s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:07 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64" released by "delete_snapshot" :: held 1.387s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:08 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Created reservations ['f5aaed94-6c74-4b6b-bdc0-16feabb8e710', '0d865179-f950-4321-bf41-aeea722fdd07', '38ccc2b4-64ab-4606-b3fc-1b8fb3b863ae', 'dc609360-0989-40b3-ac10-167ada7b8fe1'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:27:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Delete snapshot completed successfully. Aug 01 15:27:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-c4ce06b3-3b1a-4faf-905d-c43166435a76 tempest-ProjectMemberTests-660978679 None] Lock "cinder-27fa4a44-3d53-46fd-93c6-bdfb45515800-delete_snapshot" released by "delete_snapshot" :: held 1.522s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Lock "cinder-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Acquiring lock "cinder-quobyte-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:08 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36f9696-2112-4cfa-a92a-4fe82f264ff5]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:27:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:08 devstack sudo[117455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 Aug 01 15:27:08 devstack sudo[117455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:09 devstack sudo[117455]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:09 devstack sudo[117462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64 Aug 01 15:27:09 devstack sudo[117462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:09 devstack sudo[117462]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64" returned: 0 in 0.253s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Lock "cinder-quobyte-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64" released by "delete_volume" :: held 0.669s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Created reservations ['5e4bc161-d68f-4480-813c-9209101f304d', '88c4ca3a-bb89-46c6-9d5e-52ba8d2c607e', 'df0bd0a8-2df5-41bc-bb2d-5ee26aafd278', '83fba80a-4d51-4152-b66c-369d0b0b3f86'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:09 devstack sudo[117465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:27:09 devstack sudo[117465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:09 devstack sudo[117465]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.237s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:27:09 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Deleted volume successfully. Aug 01 15:27:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0adde31c-7862-409d-97f0-f32dff00b2a3 tempest-ProjectMemberTests-660978679 None] Lock "cinder-f55cf8f1-a75c-49b4-b69d-8eb1c7f92c64-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:18 devstack sudo[117469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:27:18 devstack sudo[117469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:18 devstack sudo[117469]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.268s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:27:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:27:19 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=3 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:27:19 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=18,cinder:INSERT=11,cinder:UPDATE=37,cinder:DELETE=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Flow 'volume_create_manager' (8f9293ab-22ae-4a9c-8703-4d1f4066405a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4129782-0e42-4252-8edf-d2e3da2b7441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4129782-0e42-4252-8edf-d2e3da2b7441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2070811491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8e0421a60c4e9ebdba3ca064844f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:21Z,use_quota=True,user_id='9afcea0e03fc45f08ab4dc90a3c6b787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42e6704-b832-4e8b-bec1-d8023f178d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42e6704-b832-4e8b-bec1-d8023f178d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2057178a-f8d3-4e5f-858f-84285f299778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2057178a-f8d3-4e5f-858f-84285f299778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b', 'volume_name': 'volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ebea5e-e71f-414c-a139-853e5e08b6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ebea5e-e71f-414c-a139-853e5e08b6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002f5b31-5c50-4efa-bd99-4ee9fca09a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:21 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Volume 281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b', 'volume_size': 1} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2070811491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8e0421a60c4e9ebdba3ca064844f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:21Z,use_quota=True,user_id='9afcea0e03fc45f08ab4dc90a3c6b787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Creating volume 281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:27:21 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:21 devstack sudo[117473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b 1073741824 Aug 01 15:27:21 devstack sudo[117473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:21 devstack sudo[117473]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b 1073741824" returned: 0 in 0.403s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:21 devstack sudo[117478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b Aug 01 15:27:21 devstack sudo[117478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:21 devstack sudo[117478]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b" returned: 0 in 0.244s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (002f5b31-5c50-4efa-bd99-4ee9fca09a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442f0722-2216-4288-b68b-11e8283ca117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:21 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Volume volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b (281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b): created successfully Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442f0722-2216-4288-b68b-11e8283ca117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:21 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Flow 'volume_create_manager' (8f9293ab-22ae-4a9c-8703-4d1f4066405a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:21 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b4e1c826-4659-4575-926f-7d62ba8926d3 tempest-ProjectReaderTests-359896546 None] Created volume successfully. Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Acquiring lock "cinder-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Lock "cinder-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Acquiring lock "cinder-quobyte-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Lock "cinder-quobyte-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e53d23-d016-413d-beb9-63f23fcdc0bd]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:22 devstack sudo[117481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b Aug 01 15:27:22 devstack sudo[117481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:22 devstack sudo[117481]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b" returned: 0 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:22 devstack sudo[117522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b Aug 01 15:27:22 devstack sudo[117522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:22 devstack sudo[117522]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b" returned: 0 in 0.240s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Lock "cinder-quobyte-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b" released by "delete_volume" :: held 0.627s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Created reservations ['dc7de477-20c8-4ffd-b064-890087a01cb8', 'ac608485-69d2-487a-b3b9-67a1d9a4ab2d', '069ef83e-5d15-4790-ac35-16547448ec93', 'ee9e6ba3-3e70-4ed1-b962-2207d7ffc821'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:22 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:23 devstack sudo[117525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:27:23 devstack sudo[117525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:23 devstack sudo[117525]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:27:23 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Deleted volume successfully. Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-b2471021-a4c8-4d64-b975-973d47a80b10 tempest-ProjectReaderTests-359896546 None] Lock "cinder-281ce6e1-cfe6-4a9c-9a1a-7f5e3603c42b-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Flow 'volume_create_manager' (f15f042b-9635-4331-beaf-4ca8608d4d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e307b936-cbd8-4cd3-ba37-73f02c8b5468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e307b936-cbd8-4cd3-ba37-73f02c8b5468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801119627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187f0fe1-cdc6-4fc8-b678-91a79439ce98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8e0421a60c4e9ebdba3ca064844f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:24Z,use_quota=True,user_id='9afcea0e03fc45f08ab4dc90a3c6b787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bf2858-c5a8-4ec8-9dee-0d1372371cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bf2858-c5a8-4ec8-9dee-0d1372371cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0bd00f-9897-46a7-be46-25d0cd7fd782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0bd00f-9897-46a7-be46-25d0cd7fd782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '187f0fe1-cdc6-4fc8-b678-91a79439ce98', 'volume_name': 'volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d073b0a7-76f3-49f9-a797-dd1c332873d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d073b0a7-76f3-49f9-a797-dd1c332873d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b8b4d1-78ad-4c5d-b417-943891e13cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:23 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Volume 187f0fe1-cdc6-4fc8-b678-91a79439ce98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98', 'volume_size': 1} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801119627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=187f0fe1-cdc6-4fc8-b678-91a79439ce98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d8e0421a60c4e9ebdba3ca064844f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:24Z,use_quota=True,user_id='9afcea0e03fc45f08ab4dc90a3c6b787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Creating volume 187f0fe1-cdc6-4fc8-b678-91a79439ce98 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:27:23 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:27:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:23 devstack sudo[117534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98 1073741824 Aug 01 15:27:23 devstack sudo[117534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:24 devstack sudo[117534]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98 1073741824" returned: 0 in 0.394s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:24 devstack sudo[117540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98 Aug 01 15:27:24 devstack sudo[117540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:24 devstack sudo[117540]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98" returned: 0 in 0.235s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b8b4d1-78ad-4c5d-b417-943891e13cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590b7de1-46bd-41f8-87af-a685c716523d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:24 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Volume volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98 (187f0fe1-cdc6-4fc8-b678-91a79439ce98): created successfully Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590b7de1-46bd-41f8-87af-a685c716523d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Flow 'volume_create_manager' (f15f042b-9635-4331-beaf-4ca8608d4d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:24 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-778aa1a6-ba55-4067-a035-8d84ad97aad7 tempest-ProjectReaderTests-359896546 None] Created volume successfully. Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Acquiring lock "cinder-187f0fe1-cdc6-4fc8-b678-91a79439ce98-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Lock "cinder-187f0fe1-cdc6-4fc8-b678-91a79439ce98-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Acquiring lock "cinder-quobyte-187f0fe1-cdc6-4fc8-b678-91a79439ce98" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Lock "cinder-quobyte-187f0fe1-cdc6-4fc8-b678-91a79439ce98" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[003815fb-facf-4e43-a228-d205a91b9883]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:27:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:25 devstack sudo[117543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98 Aug 01 15:27:25 devstack sudo[117543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:25 devstack sudo[117543]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98" returned: 0 in 0.358s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:25 devstack sudo[117548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98 Aug 01 15:27:25 devstack sudo[117548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:25 devstack sudo[117548]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-187f0fe1-cdc6-4fc8-b678-91a79439ce98" returned: 0 in 0.248s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Lock "cinder-quobyte-187f0fe1-cdc6-4fc8-b678-91a79439ce98" released by "delete_volume" :: held 0.642s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Created reservations ['e804b6f2-2886-4914-b3b6-f8b3829f2a2f', '766d0f2c-23f7-4337-b5ba-552c5e436a29', '4815fdd8-b725-45eb-bf65-d5bdc35d06f7', '3803bf70-bc68-4d28-8dfb-977886cae259'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:25 devstack sudo[117551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:27:25 devstack sudo[117551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:25 devstack sudo[117551]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.235s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:27:25 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Deleted volume successfully. Aug 01 15:27:25 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-7316fec2-2c81-4410-89bb-ebe33b943d71 tempest-ProjectReaderTests-359896546 None] Lock "cinder-187f0fe1-cdc6-4fc8-b678-91a79439ce98-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:35 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=26,cinder:SELECT=14,cinder:INSERT=7,cinder:DELETE=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:27:35 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=14,cinder:UPDATE=18,cinder:DELETE=3,cinder:INSERT=3 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Flow 'volume_create_manager' (a2bccc4c-a448-4927-8cff-b20dfd0e85ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5096ec34-0c09-4f34-a07d-a9d15088fe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5096ec34-0c09-4f34-a07d-a9d15088fe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802432915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2e14e1-9ea5-49ad-9ac1-83db290d830c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c80cc36412427988d5a1b6d4f5ac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:37Z,use_quota=True,user_id='ba8fd512d18e4279919eda05480cbbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff85da52-621b-4f00-9fa3-28aa4ea6df63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff85da52-621b-4f00-9fa3-28aa4ea6df63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebd83f1-314a-4763-8629-7aebde9e90a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebd83f1-314a-4763-8629-7aebde9e90a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2e14e1-9ea5-49ad-9ac1-83db290d830c', 'volume_name': 'volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf258e7-aa1b-4fd4-90d2-995b8fcb712e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf258e7-aa1b-4fd4-90d2-995b8fcb712e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85fa05a-ed2e-4d91-a70d-bc909569b13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:37 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Volume 2f2e14e1-9ea5-49ad-9ac1-83db290d830c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c', 'volume_size': 1} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802432915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2e14e1-9ea5-49ad-9ac1-83db290d830c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c80cc36412427988d5a1b6d4f5ac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:37Z,use_quota=True,user_id='ba8fd512d18e4279919eda05480cbbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Creating volume 2f2e14e1-9ea5-49ad-9ac1-83db290d830c {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:27:37 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:37 devstack sudo[117558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c 1073741824 Aug 01 15:27:37 devstack sudo[117558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:37 devstack sudo[117558]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:37 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c 1073741824" returned: 0 in 0.413s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:38 devstack sudo[117563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c Aug 01 15:27:38 devstack sudo[117563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:38 devstack sudo[117563]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c" returned: 0 in 0.241s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85fa05a-ed2e-4d91-a70d-bc909569b13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3d65fe-8cb8-4586-88c8-c5e12c37acde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:38 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Volume volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c (2f2e14e1-9ea5-49ad-9ac1-83db290d830c): created successfully Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3d65fe-8cb8-4586-88c8-c5e12c37acde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Flow 'volume_create_manager' (a2bccc4c-a448-4927-8cff-b20dfd0e85ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:38 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-179e71f5-aace-42e7-8782-8fa1536f8104 tempest-ProjectReaderTests-321526553 None] Created volume successfully. Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Acquiring lock "cinder-2f2e14e1-9ea5-49ad-9ac1-83db290d830c-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Lock "cinder-2f2e14e1-9ea5-49ad-9ac1-83db290d830c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Acquiring lock "cinder-quobyte-2f2e14e1-9ea5-49ad-9ac1-83db290d830c" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Lock "cinder-quobyte-2f2e14e1-9ea5-49ad-9ac1-83db290d830c" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[613b285c-8729-4456-9907-1c0415618810]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:27:38 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:38 devstack sudo[117566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c Aug 01 15:27:38 devstack sudo[117566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:39 devstack sudo[117566]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c" returned: 0 in 0.359s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:39 devstack sudo[117571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c Aug 01 15:27:39 devstack sudo[117571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:39 devstack sudo[117571]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-2f2e14e1-9ea5-49ad-9ac1-83db290d830c" returned: 0 in 0.247s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Lock "cinder-quobyte-2f2e14e1-9ea5-49ad-9ac1-83db290d830c" released by "delete_volume" :: held 0.642s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Created reservations ['b9a45433-e87c-446f-8824-b866b7abbea1', '15f6e51b-3e68-4772-8073-a69a0f5a8aef', '14b532c3-0f37-41f9-85aa-3dbc6b0a43a6', '4eea07d4-696d-4319-b1d5-a7f510037b60'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:39 devstack sudo[117574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:27:39 devstack sudo[117574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:39 devstack sudo[117574]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.255s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:27:39 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Deleted volume successfully. Aug 01 15:27:39 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0f4374a1-45e7-42a1-ac4f-3dfd24e0f010 tempest-ProjectReaderTests-321526553 None] Lock "cinder-2f2e14e1-9ea5-49ad-9ac1-83db290d830c-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Flow 'volume_create_manager' (038e6d5b-a74f-4314-920c-445a66d71854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f76713-e878-4421-b276-d788c45007d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f76713-e878-4421-b276-d788c45007d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673747474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a11877b-33bd-4807-8153-9b3e913304c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c80cc36412427988d5a1b6d4f5ac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:40Z,use_quota=True,user_id='ba8fd512d18e4279919eda05480cbbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fb4f60-bd94-42fa-97d9-d02ffa5a50c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fb4f60-bd94-42fa-97d9-d02ffa5a50c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73b943e-2d24-4f3a-b86b-ba5965b9c9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73b943e-2d24-4f3a-b86b-ba5965b9c9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a11877b-33bd-4807-8153-9b3e913304c7', 'volume_name': 'volume-0a11877b-33bd-4807-8153-9b3e913304c7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2449bc8f-ebf2-4279-816d-e4f7a82e6682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2449bc8f-ebf2-4279-816d-e4f7a82e6682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daffcec8-c78e-485f-b283-4c048105886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:40 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Volume 0a11877b-33bd-4807-8153-9b3e913304c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a11877b-33bd-4807-8153-9b3e913304c7', 'volume_size': 1} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673747474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a11877b-33bd-4807-8153-9b3e913304c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c80cc36412427988d5a1b6d4f5ac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:40Z,use_quota=True,user_id='ba8fd512d18e4279919eda05480cbbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Creating volume 0a11877b-33bd-4807-8153-9b3e913304c7 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:27:40 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:40 devstack sudo[117578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7 1073741824 Aug 01 15:27:40 devstack sudo[117578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:40 devstack sudo[117578]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7 1073741824" returned: 0 in 0.396s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:40 devstack sudo[117583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7 Aug 01 15:27:40 devstack sudo[117583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:40 devstack sudo[117583]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7" returned: 0 in 0.241s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daffcec8-c78e-485f-b283-4c048105886b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a11877b-33bd-4807-8153-9b3e913304c7', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60c2ad6-6af3-4bda-9731-2e789ac9da85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:40 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Volume volume-0a11877b-33bd-4807-8153-9b3e913304c7 (0a11877b-33bd-4807-8153-9b3e913304c7): created successfully Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60c2ad6-6af3-4bda-9731-2e789ac9da85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:40 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Flow 'volume_create_manager' (038e6d5b-a74f-4314-920c-445a66d71854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:41 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-523906b3-8759-4b7a-b603-421067e06497 tempest-ProjectReaderTests-321526553 None] Created volume successfully. Aug 01 15:27:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Acquiring lock "cinder-0a11877b-33bd-4807-8153-9b3e913304c7-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Lock "cinder-0a11877b-33bd-4807-8153-9b3e913304c7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Acquiring lock "cinder-quobyte-0a11877b-33bd-4807-8153-9b3e913304c7" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Lock "cinder-quobyte-0a11877b-33bd-4807-8153-9b3e913304c7" acquired by "delete_volume" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:41 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847d286-cdef-4cb2-aa68-97aa3fe996e7]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:27:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:41 devstack sudo[117586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7 Aug 01 15:27:41 devstack sudo[117586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:41 devstack sudo[117586]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:41 devstack sudo[117591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7 Aug 01 15:27:41 devstack sudo[117591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:41 devstack sudo[117591]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:41 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-0a11877b-33bd-4807-8153-9b3e913304c7" returned: 0 in 0.243s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:41 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Lock "cinder-quobyte-0a11877b-33bd-4807-8153-9b3e913304c7" released by "delete_volume" :: held 0.629s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:41 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Created reservations ['fb15d797-317e-4efa-aec0-5757b9f7795d', 'fd3c2d49-4372-478d-83d3-60d29957e4bc', 'f0a1f3ac-334e-4938-97eb-50c8822a6a85', '52ce4603-84f6-4f2b-ba38-599ab6f84970'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:42 devstack sudo[117594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:27:42 devstack sudo[117594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:42 devstack sudo[117594]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.254s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:27:42 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Deleted volume successfully. Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-1c361e73-9e06-43c8-8649-60ee953ec260 tempest-ProjectReaderTests-321526553 None] Lock "cinder-0a11877b-33bd-4807-8153-9b3e913304c7-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Flow 'volume_create_manager' (f19b4b65-9a85-488e-ac18-949310845e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e525f1d-744f-4408-a934-90f0d425d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e525f1d-744f-4408-a934-90f0d425d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337548687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1da16bf-d75a-474b-9e08-568b0b3c0ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c80cc36412427988d5a1b6d4f5ac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:43Z,use_quota=True,user_id='ba8fd512d18e4279919eda05480cbbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd7b6e2-970e-43cd-b424-f20075889b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd7b6e2-970e-43cd-b424-f20075889b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e42795f-5127-4c0e-b995-5b7ecfcdca46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e42795f-5127-4c0e-b995-5b7ecfcdca46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1da16bf-d75a-474b-9e08-568b0b3c0ae6', 'volume_name': 'volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0e8555-c9c3-4e21-bdd8-b04b85260733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0e8555-c9c3-4e21-bdd8-b04b85260733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24819fd4-f997-48fd-ac80-6772c9e6fc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:42 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Volume c1da16bf-d75a-474b-9e08-568b0b3c0ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6', 'volume_size': 1} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337548687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1da16bf-d75a-474b-9e08-568b0b3c0ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c80cc36412427988d5a1b6d4f5ac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:43Z,use_quota=True,user_id='ba8fd512d18e4279919eda05480cbbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Creating volume c1da16bf-d75a-474b-9e08-568b0b3c0ae6 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:27:42 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:27:42 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:42 devstack sudo[117597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6 1073741824 Aug 01 15:27:42 devstack sudo[117597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:43 devstack sudo[117597]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6 1073741824" returned: 0 in 0.415s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:43 devstack sudo[117603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6 Aug 01 15:27:43 devstack sudo[117603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:43 devstack sudo[117603]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6" returned: 0 in 0.241s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24819fd4-f997-48fd-ac80-6772c9e6fc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8333f313-22b1-4d50-872b-2b1252671f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:43 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Volume volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6 (c1da16bf-d75a-474b-9e08-568b0b3c0ae6): created successfully Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8333f313-22b1-4d50-872b-2b1252671f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Flow 'volume_create_manager' (f19b4b65-9a85-488e-ac18-949310845e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:43 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-5bcdb695-68c8-4b84-9ee7-f5fc4831f4e3 tempest-ProjectReaderTests-321526553 None] Created volume successfully. Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Acquiring lock "cinder-c1da16bf-d75a-474b-9e08-568b0b3c0ae6-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Lock "cinder-c1da16bf-d75a-474b-9e08-568b0b3c0ae6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Acquiring lock "cinder-quobyte-c1da16bf-d75a-474b-9e08-568b0b3c0ae6" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Lock "cinder-quobyte-c1da16bf-d75a-474b-9e08-568b0b3c0ae6" acquired by "delete_volume" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b87891-b132-452f-8a4d-465043e192af]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:27:43 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:44 devstack sudo[117606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6 Aug 01 15:27:44 devstack sudo[117606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:44 devstack sudo[117606]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6" returned: 0 in 0.359s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:44 devstack sudo[117611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6 Aug 01 15:27:44 devstack sudo[117611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:44 devstack sudo[117611]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-c1da16bf-d75a-474b-9e08-568b0b3c0ae6" returned: 0 in 0.253s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Lock "cinder-quobyte-c1da16bf-d75a-474b-9e08-568b0b3c0ae6" released by "delete_volume" :: held 0.650s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Created reservations ['3eea7b31-6c36-4b6b-981e-0efbad1ada39', '6f2227d0-3f15-43a3-aba7-b2f54b274843', 'aae69a5c-4127-401c-893f-41d940a009b4', 'ff23ecff-1f1a-48ae-b1ae-51e9fdc86c93'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:44 devstack sudo[117614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:27:44 devstack sudo[117614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:44 devstack sudo[117614]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.248s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:44 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:27:44 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Deleted volume successfully. Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-ae1a0f03-4812-4360-818d-be83f5fe00bf tempest-ProjectReaderTests-321526553 None] Lock "cinder-c1da16bf-d75a-474b-9e08-568b0b3c0ae6-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Flow 'volume_create_manager' (56b2fc27-22a5-42e3-a39d-2b8e878724c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5cd8d7-ac38-413c-a904-4d4f7ed909cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5cd8d7-ac38-413c-a904-4d4f7ed909cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437584932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c80cc36412427988d5a1b6d4f5ac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:45Z,use_quota=True,user_id='ba8fd512d18e4279919eda05480cbbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445bd588-e3c0-4955-a4fe-82acdf49045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445bd588-e3c0-4955-a4fe-82acdf49045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53516f72-c307-41df-8ad2-3b8c7fad11e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53516f72-c307-41df-8ad2-3b8c7fad11e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50', 'volume_name': 'volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e607d72e-50db-42a9-a91e-26033e814f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e607d72e-50db-42a9-a91e-26033e814f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcc94ae-626d-4f8b-b69a-07dae2c0f64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:45 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Volume 94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50', 'volume_size': 1} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437584932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c80cc36412427988d5a1b6d4f5ac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:27:45Z,use_quota=True,user_id='ba8fd512d18e4279919eda05480cbbba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Creating volume 94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:27:45 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:45 devstack sudo[117617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50 1073741824 Aug 01 15:27:45 devstack sudo[117617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:45 devstack sudo[117617]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50 1073741824" returned: 0 in 0.418s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:45 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:46 devstack sudo[117623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50 Aug 01 15:27:46 devstack sudo[117623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:46 devstack sudo[117623]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50" returned: 0 in 0.238s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcc94ae-626d-4f8b-b69a-07dae2c0f64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0ce25a-694a-4a4c-ba30-9486d4454e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:27:46 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Volume volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50 (94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50): created successfully Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0ce25a-694a-4a4c-ba30-9486d4454e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Flow 'volume_create_manager' (56b2fc27-22a5-42e3-a39d-2b8e878724c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:27:46 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-6b4efa50-1c9c-4822-876a-e53abf0241e6 tempest-ProjectReaderTests-321526553 None] Created volume successfully. Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Acquiring lock "cinder-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Lock "cinder-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Acquiring lock "cinder-quobyte-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Lock "cinder-quobyte-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2228155c-dfaa-4f1b-b931-8c0d83222701]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:46 devstack sudo[117626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50 Aug 01 15:27:46 devstack sudo[117626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:46 devstack sudo[117626]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50" returned: 0 in 0.355s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:46 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:46 devstack sudo[117631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50 Aug 01 15:27:46 devstack sudo[117631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:47 devstack sudo[117631]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50" returned: 0 in 0.247s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Lock "cinder-quobyte-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50" released by "delete_volume" :: held 0.644s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Created reservations ['ac49bf41-545d-4641-b9d6-94994300698e', '7133fbe8-dc79-4285-b461-a1d3cfc5140d', '7aebd1a9-52cb-4951-b668-239f96bb117f', '89901f2f-3024-4ce1-aa05-e778af70fae8'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:27:47 devstack sudo[117634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:27:47 devstack sudo[117634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:27:47 devstack sudo[117634]: pam_unix(sudo:session): session closed for user root Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.240s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:27:47 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Deleted volume successfully. Aug 01 15:27:47 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-e9679085-401d-499e-8bfd-99aebb81dcb0 tempest-ProjectReaderTests-321526553 None] Lock "cinder-94ed4dd0-4ac3-4061-8cf1-c841fe4b6b50-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:27:57 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=46,cinder:SELECT=28,cinder:INSERT=9,cinder:DELETE=3 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:27:57 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=28,cinder:UPDATE=42,cinder:INSERT=11,cinder:DELETE=5 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Flow 'volume_create_manager' (d7bdb0c4-1d2e-466c-88bb-9ec904503d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a4a99f-5217-4c81-bd69-38e4c968e1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a4a99f-5217-4c81-bd69-38e4c968e1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-580790427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc103d16-c8b3-4395-b83c-d0fef3636f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3e2d90fe9f4f809fd6c09c166de456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:28:07Z,use_quota=True,user_id='9fae181d6ca2483e89066be5d06e7871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54944fa-b746-4df0-aedd-aed12251097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54944fa-b746-4df0-aedd-aed12251097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5f5236-2953-4b99-9953-f49f453da642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5f5236-2953-4b99-9953-f49f453da642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc103d16-c8b3-4395-b83c-d0fef3636f71', 'volume_name': 'volume-fc103d16-c8b3-4395-b83c-d0fef3636f71', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3e54bc-6d87-41be-8150-62ddf0acad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3e54bc-6d87-41be-8150-62ddf0acad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7694365b-ec5e-49c4-a3a8-7bb4667d1586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:07 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Volume fc103d16-c8b3-4395-b83c-d0fef3636f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc103d16-c8b3-4395-b83c-d0fef3636f71', 'volume_size': 1} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-580790427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc103d16-c8b3-4395-b83c-d0fef3636f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3e2d90fe9f4f809fd6c09c166de456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:28:07Z,use_quota=True,user_id='9fae181d6ca2483e89066be5d06e7871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Creating volume fc103d16-c8b3-4395-b83c-d0fef3636f71 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:28:07 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:07 devstack sudo[117642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 1073741824 Aug 01 15:28:07 devstack sudo[117642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:07 devstack sudo[117642]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 1073741824" returned: 0 in 0.418s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:07 devstack sudo[117647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 Aug 01 15:28:07 devstack sudo[117647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:07 devstack sudo[117647]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71" returned: 0 in 0.242s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:28:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:28:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7694365b-ec5e-49c4-a3a8-7bb4667d1586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc103d16-c8b3-4395-b83c-d0fef3636f71', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cb9863-e64d-49d3-a4f6-8fef12fa237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:08 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Volume volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 (fc103d16-c8b3-4395-b83c-d0fef3636f71): created successfully Aug 01 15:28:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cb9863-e64d-49d3-a4f6-8fef12fa237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:08 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Flow 'volume_create_manager' (d7bdb0c4-1d2e-466c-88bb-9ec904503d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:28:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-8dd2034c-692e-4c06-b088-286c07c6b3c0 tempest-SnapshotDependencyTests-2133504069 None] Created volume successfully. Aug 01 15:28:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:28:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:28:08 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] Creating offline snapshot d69a02fa-15d6-4923-b1d7-165515ec3306 of volume fc103d16-c8b3-4395-b83c-d0fef3636f71 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:28:08 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5666133-65cb-4be7-96a9-b9438393d40c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:28:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:08 devstack sudo[117650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 Aug 01 15:28:08 devstack sudo[117650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:08 devstack sudo[117650]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71" returned: 0 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:08 devstack sudo[117655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 1G Aug 01 15:28:08 devstack sudo[117655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:09 devstack sudo[117655]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 1G" returned: 0 in 0.380s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:09 devstack sudo[117660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 Aug 01 15:28:09 devstack sudo[117660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:09 devstack sudo[117660]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306" returned: 0 in 0.293s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:09 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 is being set with open permissions: ugo+rw Aug 01 15:28:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:09 devstack sudo[117665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 Aug 01 15:28:09 devstack sudo[117665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:09 devstack sudo[117665]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:09 devstack sudo[117668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.info Aug 01 15:28:09 devstack sudo[117668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:10 devstack sudo[117668]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.info" returned: 0 in 0.257s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:10 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.info is being set with open permissions: ugo+rw Aug 01 15:28:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:10 devstack sudo[117671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.info Aug 01 15:28:10 devstack sudo[117671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:10 devstack sudo[117671]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.info" returned: 0 in 0.243s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:28:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2340b0e8-8c1a-4259-af8e-e103a42826aa tempest-SnapshotDependencyTests-2133504069 None] Create snapshot completed successfully Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Flow 'volume_create_manager' (353d0473-c5ba-4c8f-94c0-5df3a68deee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31244484-a262-451f-8649-bcb62045d4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31244484-a262-451f-8649-bcb62045d4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a422c3c-45b3-421a-9bdf-e442d136c6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff3e2d90fe9f4f809fd6c09c166de456',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d69a02fa-15d6-4923-b1d7-165515ec3306,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:28:11Z,use_quota=True,user_id='9fae181d6ca2483e89066be5d06e7871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ce71ac-b7fe-4a42-9dd8-fca9cc9ce261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ce71ac-b7fe-4a42-9dd8-fca9cc9ce261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb9f94f-0c39-499b-8776-22dcc3abb1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb9f94f-0c39-499b-8776-22dcc3abb1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a422c3c-45b3-421a-9bdf-e442d136c6d6', 'volume_name': 'volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6', 'volume_size': 1, 'snapshot_id': 'd69a02fa-15d6-4923-b1d7-165515ec3306'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b968e1-f7a6-405d-a9af-95dfde24f0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b968e1-f7a6-405d-a9af-95dfde24f0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecb4198-2466-43ce-9f93-6d6e92fefe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:11 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Volume 1a422c3c-45b3-421a-9bdf-e442d136c6d6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6', 'volume_size': 1, 'snapshot_id': 'd69a02fa-15d6-4923-b1d7-165515ec3306'} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "cinder-quobyte-d69a02fa-15d6-4923-b1d7-165515ec3306-1a422c3c-45b3-421a-9bdf-e442d136c6d6" by "_create_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-d69a02fa-15d6-4923-b1d7-165515ec3306-1a422c3c-45b3-421a-9bdf-e442d136c6d6" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Creating volume 1a422c3c-45b3-421a-9bdf-e442d136c6d6 from snapshot d69a02fa-15d6-4923-b1d7-165515ec3306 {{(pid=89024) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "cinder-quobyte-1a422c3c-45b3-421a-9bdf-e442d136c6d6" by "_copy_volume_from_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-1a422c3c-45b3-421a-9bdf-e442d136c6d6" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] snapshot: d69a02fa-15d6-4923-b1d7-165515ec3306, volume: 1a422c3c-45b3-421a-9bdf-e442d136c6d6, {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[6414853b-75d6-4113-a96d-a942b80a355d]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:11 devstack sudo[117676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 Aug 01 15:28:11 devstack sudo[117676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:11 devstack sudo[117676]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306" returned: 0 in 0.363s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc103d16-c8b3-4395-b83c-d0fef3636f71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[248a306c-0162-4c60-ba1c-0a1bcfe279dc]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:28:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:11 devstack sudo[117681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 Aug 01 15:28:11 devstack sudo[117681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:12 devstack sudo[117681]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71" returned: 0 in 0.359s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] will copy from snapshot at /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 01 15:28:12 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Creating direct copy from snapshot {{(pid=89024) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 01 15:28:12 devstack cinder-volume[89024]: DEBUG cinder.utils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Path /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 not found in is_blk_device check {{(pid=89024) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 01 15:28:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:12 devstack sudo[117686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 Aug 01 15:28:12 devstack sudo[117686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:16 devstack sudo[117686]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6" returned: 0 in 4.102s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:16 devstack cinder-volume[89024]: DEBUG cinder.image.image_utils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Image conversion details: src /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71, size 1024.00 MB, duration 4.10 sec, destination /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 {{(pid=89024) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:542}} Aug 01 15:28:16 devstack cinder-volume[89024]: INFO cinder.image.image_utils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Converted 1024.00 MB image at 249.53 MB/s Aug 01 15:28:16 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 is being set with open permissions: ugo+rw Aug 01 15:28:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:16 devstack sudo[117699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 Aug 01 15:28:16 devstack sudo[117699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:16 devstack sudo[117699]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6" returned: 0 in 0.251s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-1a422c3c-45b3-421a-9bdf-e442d136c6d6" released by "_copy_volume_from_snapshot" :: held 5.164s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:28:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-d69a02fa-15d6-4923-b1d7-165515ec3306-1a422c3c-45b3-421a-9bdf-e442d136c6d6" released by "_create_volume_from_snapshot" :: held 5.237s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:28:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.254s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:28:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecb4198-2466-43ce-9f93-6d6e92fefe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6', 'volume_size': 1, 'snapshot_id': 'd69a02fa-15d6-4923-b1d7-165515ec3306'}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc26c6d8-4369-46dc-908c-a43f61326c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:28:16 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Volume volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 (1a422c3c-45b3-421a-9bdf-e442d136c6d6): created successfully Aug 01 15:28:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc26c6d8-4369-46dc-908c-a43f61326c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:28:16 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Flow 'volume_create_manager' (353d0473-c5ba-4c8f-94c0-5df3a68deee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:28:16 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-2b9a654a-919d-4ea2-96f6-3a57c40d2840 tempest-SnapshotDependencyTests-2133504069 None] Created volume successfully. Aug 01 15:28:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "cinder-d69a02fa-15d6-4923-b1d7-165515ec3306-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:28:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-d69a02fa-15d6-4923-b1d7-165515ec3306-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:28:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "cinder-quobyte-fc103d16-c8b3-4395-b83c-d0fef3636f71" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:28:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-fc103d16-c8b3-4395-b83c-d0fef3636f71" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:28:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "cinder-quobyte-d69a02fa-15d6-4923-b1d7-165515ec3306" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:28:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-d69a02fa-15d6-4923-b1d7-165515ec3306" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:28:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Deleting offline snapshot d69a02fa-15d6-4923-b1d7-165515ec3306 of volume fc103d16-c8b3-4395-b83c-d0fef3636f71 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:28:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] snapshot_file for this snap is: volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:28:17 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[53924f4b-126a-4268-9e5c-46842e73643c]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:28:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:17 devstack sudo[117702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 Aug 01 15:28:17 devstack sudo[117702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:18 devstack sudo[117702]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306" returned: 0 in 0.348s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc103d16-c8b3-4395-b83c-d0fef3636f71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9a89a0-0bfd-468d-bec4-f2c7bf1497ff]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:18 devstack sudo[117707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 Aug 01 15:28:18 devstack sudo[117707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:18 devstack sudo[117711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:28:18 devstack sudo[117711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:18 devstack sudo[117707]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71" returned: 0 in 0.548s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:18 devstack sudo[117714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 Aug 01 15:28:18 devstack sudo[117714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:18 devstack sudo[117711]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.243s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:28:18 devstack sudo[117714]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306" returned: 0 in 0.339s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:19 devstack sudo[117720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306 Aug 01 15:28:19 devstack sudo[117720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:19 devstack sudo[117720]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71.d69a02fa-15d6-4923-b1d7-165515ec3306" returned: 0 in 0.241s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-d69a02fa-15d6-4923-b1d7-165515ec3306" released by "_delete_snapshot" :: held 1.577s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:28:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-fc103d16-c8b3-4395-b83c-d0fef3636f71" released by "delete_snapshot" :: held 1.602s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:28:19 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Created reservations ['d6b306c3-a916-42c4-b77c-fd154c20e713', 'd0374c95-7a43-4a4f-a0d1-40be8bd25925', '8660e912-ecf2-4339-b7b1-8a6cfdec3bf9', 'f504f5e0-6122-4586-a295-cf80c6c86e62'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:28:19 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Delete snapshot completed successfully. Aug 01 15:28:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-066b5984-ca41-408c-9f21-c38c7197beab tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-d69a02fa-15d6-4923-b1d7-165515ec3306-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:28:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "cinder-fc103d16-c8b3-4395-b83c-d0fef3636f71-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:28:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-fc103d16-c8b3-4395-b83c-d0fef3636f71-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:28:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "cinder-quobyte-fc103d16-c8b3-4395-b83c-d0fef3636f71" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:28:19 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-fc103d16-c8b3-4395-b83c-d0fef3636f71" acquired by "delete_volume" :: waited 0.012s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:28:19 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[2855df6f-be20-4c2a-a85d-fa78cda3367b]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:28:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:20 devstack sudo[117723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 Aug 01 15:28:20 devstack sudo[117723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:20 devstack sudo[117723]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71" returned: 0 in 0.364s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:20 devstack sudo[117729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71 Aug 01 15:28:20 devstack sudo[117729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:20 devstack sudo[117729]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-fc103d16-c8b3-4395-b83c-d0fef3636f71" returned: 0 in 0.247s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-fc103d16-c8b3-4395-b83c-d0fef3636f71" released by "delete_volume" :: held 0.673s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Created reservations ['35f86a93-40b8-4641-864a-a7159e1092b6', '4063fefb-97da-4075-9b6c-df5966776bf3', 'c81f48f4-3041-4d38-a214-3c6646d590a4', 'e9daf880-14df-489e-bd59-2a10318fc40c'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:20 devstack sudo[117732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:28:20 devstack sudo[117732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:20 devstack sudo[117732]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.243s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:28:20 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Deleted volume successfully. Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-0716b8fd-28b0-4af5-a989-c0278307575f tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-fc103d16-c8b3-4395-b83c-d0fef3636f71-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "cinder-1a422c3c-45b3-421a-9bdf-e442d136c6d6-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:28:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-1a422c3c-45b3-421a-9bdf-e442d136c6d6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "cinder-quobyte-1a422c3c-45b3-421a-9bdf-e442d136c6d6" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-1a422c3c-45b3-421a-9bdf-e442d136c6d6" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[17051793-fbbb-4bca-9a7e-4133f9a31e3a]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:21 devstack sudo[117735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 Aug 01 15:28:21 devstack sudo[117735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:21 devstack sudo[117735]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6" returned: 0 in 0.359s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:21 devstack sudo[117740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6 Aug 01 15:28:21 devstack sudo[117740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:21 devstack sudo[117740]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-1a422c3c-45b3-421a-9bdf-e442d136c6d6" returned: 0 in 0.240s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-quobyte-1a422c3c-45b3-421a-9bdf-e442d136c6d6" released by "delete_volume" :: held 0.647s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Created reservations ['1c132c4d-ca53-4280-b61e-fe6726c20951', '919b31ed-abbd-41ae-9950-498ea99baa18', 'f8464002-19db-4118-8cbc-0e8017caec8b', '56779bd1-371c-4c86-85d0-3248f0417557'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:28:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:28:21 devstack sudo[117743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:28:21 devstack sudo[117743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:28:22 devstack sudo[117743]: pam_unix(sudo:session): session closed for user root Aug 01 15:28:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.251s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:28:22 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:28:22 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Deleted volume successfully. Aug 01 15:28:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-791edff6-9f2b-44c2-aa0e-c6e7137d7403 tempest-SnapshotDependencyTests-2133504069 None] Lock "cinder-1a422c3c-45b3-421a-9bdf-e442d136c6d6-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:28:31 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=27,cinder:INSERT=9,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:28:32 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=22,cinder:UPDATE=31,cinder:DELETE=4,cinder:INSERT=6 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:28:58 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:28:58 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:29:18 devstack sudo[117805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:29:18 devstack sudo[117805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:29:18 devstack sudo[117805]: pam_unix(sudo:session): session closed for user root Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.254s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:29:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (0865c4eb-6e06-4354-a91c-94c9f07ad630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5898d4-3fb9-4ce1-9a56-b8ece0ecc79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5898d4-3fb9-4ce1-9a56-b8ece0ecc79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787250908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34285ab3-574f-49d4-9568-d1ba50697bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:30:04Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df8b3df-3a2c-437c-8b46-f9f181ec0531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df8b3df-3a2c-437c-8b46-f9f181ec0531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11aafeb1-aa09-4da5-bc0f-5a154ddd5209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11aafeb1-aa09-4da5-bc0f-5a154ddd5209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34285ab3-574f-49d4-9568-d1ba50697bcd', 'volume_name': 'volume-34285ab3-574f-49d4-9568-d1ba50697bcd', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a96d34-63b3-4e18-9036-b94dc9594b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a96d34-63b3-4e18-9036-b94dc9594b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66786dc-cb06-44e8-b658-cd61e58a59c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:03 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Volume 34285ab3-574f-49d4-9568-d1ba50697bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34285ab3-574f-49d4-9568-d1ba50697bcd', 'volume_size': 1} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787250908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34285ab3-574f-49d4-9568-d1ba50697bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:30:04Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Creating volume 34285ab3-574f-49d4-9568-d1ba50697bcd {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:30:03 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:30:03 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:03 devstack sudo[117858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd 1073741824 Aug 01 15:30:03 devstack sudo[117858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:04 devstack sudo[117858]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd 1073741824" returned: 0 in 0.396s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:04 devstack sudo[117866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd Aug 01 15:30:04 devstack sudo[117866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:04 devstack sudo[117866]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd" returned: 0 in 0.250s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66786dc-cb06-44e8-b658-cd61e58a59c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34285ab3-574f-49d4-9568-d1ba50697bcd', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6619637d-fc5f-4388-972b-5bb855b3d464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:04 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Volume volume-34285ab3-574f-49d4-9568-d1ba50697bcd (34285ab3-574f-49d4-9568-d1ba50697bcd): created successfully Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6619637d-fc5f-4388-972b-5bb855b3d464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (0865c4eb-6e06-4354-a91c-94c9f07ad630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:30:04 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-01cddf8e-3ea8-46f7-bdcc-5d4018a5891f tempest-ProjectReaderTests-1876340520 None] Created volume successfully. Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] Creating offline snapshot de7883d4-2f7d-41ef-be3c-360473ce279f of volume 34285ab3-574f-49d4-9568-d1ba50697bcd {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[9612e3f4-848a-4e73-a56d-acea074daa50]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:04 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:04 devstack sudo[117869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd Aug 01 15:30:04 devstack sudo[117869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:05 devstack sudo[117869]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd" returned: 0 in 0.349s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:05 devstack sudo[117874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f 1G Aug 01 15:30:05 devstack sudo[117874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:05 devstack sudo[117874]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f 1G" returned: 0 in 0.372s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34285ab3-574f-49d4-9568-d1ba50697bcd -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:05 devstack sudo[117879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34285ab3-574f-49d4-9568-d1ba50697bcd -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f Aug 01 15:30:05 devstack sudo[117879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:05 devstack sudo[117879]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34285ab3-574f-49d4-9568-d1ba50697bcd -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f" returned: 0 in 0.285s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:05 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f is being set with open permissions: ugo+rw Aug 01 15:30:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:05 devstack sudo[117885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f Aug 01 15:30:05 devstack sudo[117885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:05 devstack sudo[117885]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:05 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f" returned: 0 in 0.229s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:06 devstack sudo[117888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.info Aug 01 15:30:06 devstack sudo[117888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:06 devstack sudo[117888]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.info" returned: 0 in 0.252s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:06 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.info is being set with open permissions: ugo+rw Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:06 devstack sudo[117891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.info Aug 01 15:30:06 devstack sudo[117891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:06 devstack sudo[117891]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.info" returned: 0 in 0.238s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:06 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-ebca564b-db92-469e-bfd3-c0b19dadd73e tempest-ProjectReaderTests-1876340520 None] Create snapshot completed successfully Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-de7883d4-2f7d-41ef-be3c-360473ce279f-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-de7883d4-2f7d-41ef-be3c-360473ce279f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-34285ab3-574f-49d4-9568-d1ba50697bcd" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-34285ab3-574f-49d4-9568-d1ba50697bcd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-de7883d4-2f7d-41ef-be3c-360473ce279f" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-de7883d4-2f7d-41ef-be3c-360473ce279f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Deleting offline snapshot de7883d4-2f7d-41ef-be3c-360473ce279f of volume 34285ab3-574f-49d4-9568-d1ba50697bcd {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] snapshot_file for this snap is: volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3135ba-9270-47d4-a0f0-2ed3f6287ccf]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:06 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:07 devstack sudo[117894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f Aug 01 15:30:07 devstack sudo[117894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:07 devstack sudo[117894]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:07 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34285ab3-574f-49d4-9568-d1ba50697bcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:30:07 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9774db5-002b-4b1c-b9ae-34cebd2af8a6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:07 devstack sudo[117899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd Aug 01 15:30:07 devstack sudo[117899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:07 devstack sudo[117899]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd" returned: 0 in 0.349s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:07 devstack sudo[117904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f Aug 01 15:30:07 devstack sudo[117904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:07 devstack sudo[117904]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f" returned: 0 in 0.331s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:07 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:08 devstack sudo[117910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f Aug 01 15:30:08 devstack sudo[117910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:08 devstack sudo[117910]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:08 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd.de7883d4-2f7d-41ef-be3c-360473ce279f" returned: 0 in 0.245s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-de7883d4-2f7d-41ef-be3c-360473ce279f" released by "_delete_snapshot" :: held 1.358s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-34285ab3-574f-49d4-9568-d1ba50697bcd" released by "delete_snapshot" :: held 1.380s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:08 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Created reservations ['5ce4bda7-6bae-43d6-b803-b35bd2d49008', '61a5fc2e-b2ab-48a4-92eb-b593fa5ec89c', '195c5f01-a46c-4310-b893-ce67d8a91ca4', '0432ef20-5b7f-4359-a3b1-141ecad11428'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:30:08 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Delete snapshot completed successfully. Aug 01 15:30:08 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50830516-7d5e-43d2-8455-9aaf0ebb1bcf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-de7883d4-2f7d-41ef-be3c-360473ce279f-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-34285ab3-574f-49d4-9568-d1ba50697bcd-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-34285ab3-574f-49d4-9568-d1ba50697bcd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-34285ab3-574f-49d4-9568-d1ba50697bcd" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-34285ab3-574f-49d4-9568-d1ba50697bcd" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e6e923-0476-4825-a7d2-babeb379be73]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:09 devstack sudo[117913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd Aug 01 15:30:09 devstack sudo[117913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:09 devstack sudo[117913]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd" returned: 0 in 0.355s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:09 devstack sudo[117918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd Aug 01 15:30:09 devstack sudo[117918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:09 devstack sudo[117918]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-34285ab3-574f-49d4-9568-d1ba50697bcd" returned: 0 in 0.241s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-34285ab3-574f-49d4-9568-d1ba50697bcd" released by "delete_volume" :: held 0.654s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Created reservations ['2990dbed-2cc0-4eb9-b10c-ae5c2d3b957a', '8e1032a7-d8a4-46be-b317-a75bdcb9fab4', '57b62f43-d521-416f-95ea-9f88c45334f3', '24de097d-23b4-420d-99d1-4d4f65197381'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:09 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:09 devstack sudo[117921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:30:09 devstack sudo[117921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:10 devstack sudo[117921]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.237s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:30:10 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Deleted volume successfully. Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-a9541d2a-ac33-49fa-bd8c-6ac1ff8cfb35 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-34285ab3-574f-49d4-9568-d1ba50697bcd-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (e6068a44-207c-4cce-b6b5-d442b7a4ad4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb73d69-a7be-452e-bdb4-0f683aca8d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb73d69-a7be-452e-bdb4-0f683aca8d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-652592598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9e54b1-b4e6-4add-92bb-6bf49ff344d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:30:11Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4225030d-6cc9-4a6e-8ea5-fc4a60677991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4225030d-6cc9-4a6e-8ea5-fc4a60677991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1cb327-b079-4d6f-abad-0f0439c3517b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1cb327-b079-4d6f-abad-0f0439c3517b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9e54b1-b4e6-4add-92bb-6bf49ff344d9', 'volume_name': 'volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2774ea-2998-4c47-9a02-305481ec51f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2774ea-2998-4c47-9a02-305481ec51f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417045b3-2676-443f-aea4-1482b753c6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:10 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Volume 7f9e54b1-b4e6-4add-92bb-6bf49ff344d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9', 'volume_size': 1} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-652592598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9e54b1-b4e6-4add-92bb-6bf49ff344d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:30:11Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Creating volume 7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:30:10 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:30:10 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:10 devstack sudo[117925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 1073741824 Aug 01 15:30:10 devstack sudo[117925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:11 devstack sudo[117925]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 1073741824" returned: 0 in 0.405s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:11 devstack sudo[117930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 Aug 01 15:30:11 devstack sudo[117930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:11 devstack sudo[117930]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9" returned: 0 in 0.237s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417045b3-2676-443f-aea4-1482b753c6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c20f646-618c-47a2-863d-72efa9180287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:11 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Volume volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 (7f9e54b1-b4e6-4add-92bb-6bf49ff344d9): created successfully Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c20f646-618c-47a2-863d-72efa9180287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (e6068a44-207c-4cce-b6b5-d442b7a4ad4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:30:11 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7cbb4236-50ca-4a00-956f-e70a684aa21b tempest-ProjectReaderTests-1876340520 None] Created volume successfully. Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] Creating offline snapshot 31615f06-cfb9-4e39-b9ee-0206df18917a of volume 7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[0021d2e2-f528-4a30-9497-5e4a0205c9d6]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:11 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:11 devstack sudo[117933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 Aug 01 15:30:11 devstack sudo[117933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:12 devstack sudo[117933]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9" returned: 0 in 0.355s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:12 devstack sudo[117938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a 1G Aug 01 15:30:12 devstack sudo[117938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:12 devstack sudo[117938]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a 1G" returned: 0 in 0.373s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:12 devstack sudo[117944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a Aug 01 15:30:12 devstack sudo[117944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:12 devstack sudo[117944]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a" returned: 0 in 0.289s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:12 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a is being set with open permissions: ugo+rw Aug 01 15:30:12 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:12 devstack sudo[117949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a Aug 01 15:30:12 devstack sudo[117949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:13 devstack sudo[117949]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a" returned: 0 in 0.237s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:13 devstack sudo[117952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.info Aug 01 15:30:13 devstack sudo[117952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:13 devstack sudo[117952]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.info" returned: 0 in 0.246s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:13 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.info is being set with open permissions: ugo+rw Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:13 devstack sudo[117955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.info Aug 01 15:30:13 devstack sudo[117955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:13 devstack sudo[117955]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.info" returned: 0 in 0.240s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:13 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-32614198-e592-42d6-b32b-c5d44e0916ae tempest-ProjectReaderTests-1876340520 None] Create snapshot completed successfully Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-31615f06-cfb9-4e39-b9ee-0206df18917a-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Lock "cinder-31615f06-cfb9-4e39-b9ee-0206df18917a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-31615f06-cfb9-4e39-b9ee-0206df18917a" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-31615f06-cfb9-4e39-b9ee-0206df18917a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Deleting offline snapshot 31615f06-cfb9-4e39-b9ee-0206df18917a of volume 7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] snapshot_file for this snap is: volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77b299c-e449-4ee8-9701-1a9107bc45e0]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:13 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:14 devstack sudo[117958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a Aug 01 15:30:14 devstack sudo[117958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:14 devstack sudo[117958]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a" returned: 0 in 0.382s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:14 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:30:14 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[073a9171-5c65-4e74-afbe-fa372ed6dab3]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:14 devstack sudo[117964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 Aug 01 15:30:14 devstack sudo[117964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:14 devstack sudo[117964]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9" returned: 0 in 0.357s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:14 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:14 devstack sudo[117969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a Aug 01 15:30:14 devstack sudo[117969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:15 devstack sudo[117969]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a" returned: 0 in 0.322s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:15 devstack sudo[117974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a Aug 01 15:30:15 devstack sudo[117974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:15 devstack sudo[117974]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:15 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9.31615f06-cfb9-4e39-b9ee-0206df18917a" returned: 0 in 0.244s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-31615f06-cfb9-4e39-b9ee-0206df18917a" released by "_delete_snapshot" :: held 1.401s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9" released by "delete_snapshot" :: held 1.422s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:15 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Created reservations ['63bff98a-3b1d-4c42-9850-b067fc019bbf', 'a7811897-7df8-4b89-80ec-39a229dc2257', '4383faa7-97a2-40b8-b2a6-d5fd039a9d12', '4ba123f3-0b06-49b2-ba73-01a3636b7024'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:30:15 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Delete snapshot completed successfully. Aug 01 15:30:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-50945436-9e5e-442c-a632-36cb1985fd9b tempest-ProjectReaderTests-1876340520 None] Lock "cinder-31615f06-cfb9-4e39-b9ee-0206df18917a-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:15 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9" acquired by "delete_volume" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d939d7-43e5-4a42-a864-f347148a11ed]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:16 devstack sudo[117977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 Aug 01 15:30:16 devstack sudo[117977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:16 devstack sudo[117977]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9" returned: 0 in 0.351s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:16 devstack sudo[117982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9 Aug 01 15:30:16 devstack sudo[117982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:16 devstack sudo[117982]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9" returned: 0 in 0.237s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9" released by "delete_volume" :: held 0.640s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Created reservations ['351e08f0-8d7e-4b68-a624-0626775e246c', '839ba90a-a809-42e2-923b-4b6be021bce7', '07d3e698-bcba-4ebf-a432-ccdf65044e04', 'b42c68e2-244b-4173-afdb-29007c07b644'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:16 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:16 devstack sudo[117985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:30:16 devstack sudo[117985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:17 devstack sudo[117985]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.241s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:30:17 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Deleted volume successfully. Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-09853325-7150-4aba-a985-6b07cfba2d64 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-7f9e54b1-b4e6-4add-92bb-6bf49ff344d9-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89024) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (3fe25835-8ba4-42a0-9fac-bb8e41d5fb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43cb99a-fb44-4920-a510-52d56967b24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43cb99a-fb44-4920-a510-52d56967b24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1118837739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:30:18Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635047ad-53a4-4975-8281-f73906a7c9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635047ad-53a4-4975-8281-f73906a7c9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c173a099-fb57-4b44-a853-fa81777c60ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c173a099-fb57-4b44-a853-fa81777c60ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9', 'volume_name': 'volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00259953-d9a0-4b4c-bcd3-2e49e1ae25bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00259953-d9a0-4b4c-bcd3-2e49e1ae25bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe0fba2-33e5-42d0-9775-b2e81491da6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:17 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Volume 7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9', 'volume_size': 1} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-01T13:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1118837739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b651adb8a3c6488b82d5d8edbfab56ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-01T13:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-01T13:30:18Z,use_quota=True,user_id='41e03e65526a4d388d0e6020268bc9c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a23c95d4-6b22-4ba8-ac4b-294892bc2977),volume_type_id=a23c95d4-6b22-4ba8-ac4b-294892bc2977)}" {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Creating volume 7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 {{(pid=89024) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Selected osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 as target Quobyte volume. {{(pid=89024) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 01 15:30:17 devstack cinder-volume[89024]: INFO cinder.volume.drivers.remotefs [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] casted to osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133 Aug 01 15:30:17 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 1073741824 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:17 devstack sudo[117988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 1073741824 Aug 01 15:30:17 devstack sudo[117988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:18 devstack sudo[117988]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 1073741824" returned: 0 in 0.425s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:18 devstack sudo[117994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 Aug 01 15:30:18 devstack sudo[117994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:18 devstack sudo[117994]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9" returned: 0 in 0.244s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'} {{(pid=89024) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe0fba2-33e5-42d0-9775-b2e81491da6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9', 'volume_size': 1}' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d7472b-9263-4cbf-9ed5-94edc674633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 01 15:30:18 devstack cinder-volume[89024]: INFO cinder.volume.flows.manager.create_volume [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Volume volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 (7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9): created successfully Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d7472b-9263-4cbf-9ed5-94edc674633c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89024) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Flow 'volume_create_manager' (3fe25835-8ba4-42a0-9fac-bb8e41d5fb28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89024) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 01 15:30:18 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-1f18b7fd-1e11-4adf-a531-c9fc6a03a65a tempest-ProjectReaderTests-1876340520 None] Created volume successfully. Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG oslo_service.periodic_task [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] Running periodic task VolumeManager._thread_info {{(pid=89024) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread count: 28 {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG cinder.volume.manager [None req-7e8ff7c0-53b8-4999-8d0e-2c4075e05f3c None None] thread info: [<_MainThread(MainThread, started 139291691516032)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89024) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] Creating offline snapshot 0d4e6a9e-d4b8-4f62-961d-a8350e914e72 of volume 7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 {{(pid=89024) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda6266b-b2e0-4523-9b55-3a66a15260c0]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:18 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:18 devstack sudo[117997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 Aug 01 15:30:18 devstack sudo[117997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:19 devstack sudo[117997]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9" returned: 0 in 0.347s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 1G {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:19 devstack sudo[118002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 1G Aug 01 15:30:19 devstack sudo[118002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:19 devstack sudo[118002]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 1G" returned: 0 in 0.377s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:19 devstack sudo[118007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 Aug 01 15:30:19 devstack sudo[118007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:19 devstack sudo[118007]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 -F qcow2 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72" returned: 0 in 0.313s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:19 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 is being set with open permissions: ugo+rw Aug 01 15:30:19 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:19 devstack sudo[118012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 Aug 01 15:30:19 devstack sudo[118012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:20 devstack sudo[118012]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72" returned: 0 in 0.246s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:20 devstack sudo[118015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.info Aug 01 15:30:20 devstack sudo[118015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:20 devstack sudo[118015]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.info" returned: 0 in 0.247s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:20 devstack cinder-volume[89024]: WARNING cinder.volume.drivers.remotefs [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.info is being set with open permissions: ugo+rw Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.info {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:20 devstack sudo[118018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.info Aug 01 15:30:20 devstack sudo[118018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:20 devstack sudo[118018]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.info" returned: 0 in 0.235s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:20 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-7f6277e1-164f-45e8-842d-7404db22bee7 tempest-ProjectReaderTests-1876340520 None] Create snapshot completed successfully Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-0d4e6a9e-d4b8-4f62-961d-a8350e914e72-delete_snapshot" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-0d4e6a9e-d4b8-4f62-961d-a8350e914e72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9" by "delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-0d4e6a9e-d4b8-4f62-961d-a8350e914e72" by "_delete_snapshot" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-0d4e6a9e-d4b8-4f62-961d-a8350e914e72" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Deleting offline snapshot 0d4e6a9e-d4b8-4f62-961d-a8350e914e72 of volume 7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] snapshot_file for this snap is: volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 {{(pid=89024) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c7874d-f089-4bb2-8f72-a0f3474033c3]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:20 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:21 devstack sudo[118022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 Aug 01 15:30:21 devstack sudo[118022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:21 devstack sudo[118022]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72" returned: 0 in 0.350s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:21 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.remotefs [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89024) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 01 15:30:21 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9ab10f-efa5-4e12-a05d-7a2b7ed888e1]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:21 devstack sudo[118027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 Aug 01 15:30:21 devstack sudo[118027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:21 devstack sudo[118027]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9" returned: 0 in 0.349s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:21 devstack sudo[118032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 Aug 01 15:30:21 devstack sudo[118032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:21 devstack sudo[118032]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72" returned: 0 in 0.327s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:21 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:21 devstack sudo[118037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72 Aug 01 15:30:21 devstack sudo[118037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:22 devstack sudo[118037]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:22 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9.0d4e6a9e-d4b8-4f62-961d-a8350e914e72" returned: 0 in 0.238s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-0d4e6a9e-d4b8-4f62-961d-a8350e914e72" released by "_delete_snapshot" :: held 1.346s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9" released by "delete_snapshot" :: held 1.368s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:22 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Created reservations ['98c03741-b5b1-43b1-a4d4-fafeee922570', '60f680c8-d2fd-4c9c-8439-c47693988ef3', '0126195e-7892-4d5f-923f-34e1e9fc0c03', '8940fcd6-2fa0-43e1-8beb-b96de148c64a'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:30:22 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Delete snapshot completed successfully. Aug 01 15:30:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-31eb1445-1e2b-4538-b8eb-11d5759204cf tempest-ProjectReaderTests-1876340520 None] Lock "cinder-0d4e6a9e-d4b8-4f62-961d-a8350e914e72-delete_snapshot" released by "delete_snapshot" :: held 1.490s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9-delete_volume" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:22 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "cinder-quobyte-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9" by "delete_volume" {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9" acquired by "delete_volume" :: waited 0.015s {{(pid=89024) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dca977-9509-43ed-8526-8dff02860fb2]: (4, 'qcow2') {{(pid=89527) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:23 devstack sudo[118040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 Aug 01 15:30:23 devstack sudo[118040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:23 devstack sudo[118040]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9" returned: 0 in 0.349s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:23 devstack sudo[118045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9 Aug 01 15:30:23 devstack sudo[118045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:23 devstack sudo[118045]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa/volume-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9" returned: 0 in 0.269s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-quobyte-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9" released by "delete_volume" :: held 0.673s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG cinder.quota [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Created reservations ['c2f0c93e-ff01-4615-8f20-f466d2d2eb8d', 'b81cf45f-477f-4586-a1b3-0d29ee04e74c', 'be28381d-c6c2-43d8-bee9-21a2550a217d', '4b702d44-b94f-4171-9dc9-51fa5389f5c1'] {{(pid=89024) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133': None} {{(pid=89024) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG cinder.volume.drivers.quobyte [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-606aaa12-2ccd-4f01-87cd-295d5389d133'] {{(pid=89024) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.lockutils [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89024) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 01 15:30:23 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 01 15:30:23 devstack sudo[118090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa Aug 01 15:30:23 devstack sudo[118090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 01 15:30:24 devstack sudo[118090]: pam_unix(sudo:session): session closed for user root Aug 01 15:30:24 devstack cinder-volume[89024]: DEBUG oslo_concurrency.processutils [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/201243ad9a850bac715a82bb60b663fa" returned: 0 in 0.249s {{(pid=89024) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 01 15:30:24 devstack cinder-volume[89024]: DEBUG cinder.manager [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Notifying Schedulers of capabilities ... {{(pid=89024) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 01 15:30:24 devstack cinder-volume[89024]: INFO cinder.volume.manager [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Deleted volume successfully. Aug 01 15:30:24 devstack cinder-volume[89024]: DEBUG cinder.coordination [None req-40d4a3f9-7d0a-4d29-9db9-e6f1cb37ce36 tempest-ProjectReaderTests-1876340520 None] Lock "cinder-7d0ee3d0-b042-40b7-bffd-42c9bc3af2b9-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=89024) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 01 15:30:33 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:UPDATE=57,cinder:SELECT=36,cinder:INSERT=15,cinder:DELETE=7 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:30:34 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=48,cinder:UPDATE=51,cinder:INSERT=15,cinder:DELETE=2 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 01 15:30:58 devstack cinder-volume[89024]: DEBUG dbcounter [-] [89024] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=89024) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}